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o 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



NEW APPLICATION TRANSMITTAL 




Box Patent Application 

Assistant Commissioner for Patents 

Washington, D.C. 20231 



NEW APPLICATION TRANSMITTAL 



Transmitted herewith for filing is the patent application of METHOD AND APPARATUS FOR 
UNIVERSALLY ACCESSIBLE COMMAND AND CONTROL INFORMATION IN A NETWORK 

Inventor(s): Richard Humpleman and Dongyan Wang 

WARNING: 

37 CFR § 7.47 (a)(1) points out: 

"(a) A Patent is applied for in the name or names of the actual inventor or inventors. 
"(1) The inventorship of a nonprovisional application is that inventorship set forth in the oath or 
declaration as prescribed by § 1.63, except as provided for in § 1.53 (d)(4) and § 1.63(d). If an 
oath or declaration as prescribed by § 1.63 is not filed during the pendency of a nonprovisional 
application, the inventorship is that inventorship set forth in the application papers filed pursuant 
to § 1.53 (b), unless a petition under this paragraph accompanied by the fee set forth in § 1. 17(i) 
is filed supplying or changing the name or names of the inventor or inventors. " 

For (title): 



1 . Type of Application 

This new application is for a(n) 



(check one applicable item below) 



Original (nonprovisional) 



[ ] 



Design 



[ ] 



Plant 
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WARNING: Do not use this transmittal for a completion in the U.S. of an international 
Application under 35 U.S.C. 371(c)(4), unless the International Application is 
being filed as a divisional, continuation or continuation-in-part application. 

WARNING: Do not use this transmittal for the filing of a provisional application. 

NOTE: If one of the following 3 items apply then complete and attach ADDED PAGES FOR 
NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF A PRIOR U.S. APPLICATION 
CLAIMED and a NOTIFICATION IN PARENT APPLICATION OF THE FILING OF THIS 
CONTINUATION APPLICATION. 

[ ] Divisional 

[ ] Continuation 

[ ] Continuation-in-part (C-I-P) 



2. Benefit of Prior U.S. Application(s) 



NOTE: A nonprovisionai application may claim an invention disclosed in one or more prior 
filed copending nonprovisionai applications or copending international applications 
designating the United States of America. In order for a nonprovisionai application 
to claim the benefit of a prior filed copending nonprovisionai application or copending 
international application designating the United States of America, each prior 
application must name as an inventor at least one inventor named in the later filed 
nonprovisionai application and disclose the named inventor's invention claimed in at 
least one claim of the later filed nonprovisionai application in the manner provided by 
the first paragraph of 35 U.S.C. 1 1 2. Each prior application must also be: 

(i) An international application entitled to a filing date in accordance with PCT Article 
1 1 and designating the United States of America; or 

(ii) Complete as set forth in § 1 .51(b); or 

(in) Entitled to a filing date as set forth in § 1 .53(b) or § 1 .53(d) and include the basic 
filing fee set forth in § 1.16; or 

(iv) Entitled to a filing date as set forth in § 1.53(b) and have paid therein the 
processing and retention fee set forth in § 1.21(1) within the time period set forth in 
§ 1.53(f). 

37 CFR § 1.78(a)(1). 

NOTE: If the new application being transmitted is a divisional, continuation or a 
continuation-in-part of a parent case, or where the parent case is an International 
Application which designated the U.S., or benefit of a prior provisional application 
is claimed, then check the following item and complete and attach ADDED PAGES 
FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. 
APPLiCATION(S) CLAIMED. 
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WARNING: 

If an application claims the benefit of the filing date of an earlier filed application under 35 U.S.C. 
120, 1 21 or 365(c), the 20-year term of that application will be based upon the filing date of the 
earliest U.S. application that the application makes reference to under 35 U.S.C. 120,121 or 
365(c). (35 U.S.C. 1 54(a)(2) does not take into account, for the determination of the patent term, 
any application on which priority is claimed under 35 U.S.C. 119, 365(a) or 365(b)). For a c-i-p 
application, applicant should review whether any claim in the patent that will issue is supported 
by an earlier application and, if not, the applicant should consider canceling the reference to the 
earlier filed application. The term of a patent is not based on a claim-by-claim approach. See 
Notice of April 14, 1995, 60 Fed. Reg. 20, 195, at 20,205. 



WARNING: 

When the last day of pendency of a provisional application falls on a Saturday, Sunday, or Federal 
holiday within the District of Columbia, any nonprovisional application claiming benefit of the 
provisional application must be filed prior to the Saturday, Sunday, or Federal holiday within the 
District of Columbia. See 37 CFR § 1.78(a)(3). 

[X] The new application being transmitted claims the benefit of prior U.S. application(s). 
Enclosed are ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE 
BENEFIT OF PRIOR U.S. APPLICATION(S) CLAIMED. 



3. Papers Enclosed 

A. Required For Filing Date Under 37 § CFR 1.53(b) (Regular) or 37 § CFR 1.153 
(Design) Application 

Pages of Specification 46 
Pages of Claims 4 
Sheets of Drawing 25 

WARNING: 

DO NOT submit original drawings. A high quality copy of the drawings should be supplied when 
filing a patent application. The drawings that are submitted to the Office must be on strong, white, 
smooth, and non-shiny paper and meet the standards according to § 1 .84. If corrections to the 
drawings are necessary, they should be made to the original drawing and a high-quality copy of the 
corrected original drawing then submitted to the Office. Only one copy is required or desired. For 
comments or proposed then-new 37 CFR 1.84, see Notice of March 9, 1988 (1990 O.G. 57-62). 
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NOTE: "Identifying indicia, if provided, should include the application number or the title 
of the invention, inventor's name, docket number (if any), and the name and telephone 
number of a person to call if the Office is unable to match the drawings to the proper 
application. This information should be placed on the back of each sheet of drawing a 
minimum distance of 1 .5 cm. (5/8 inch) down from the top of the page ..."37 CFR 1 .84 
(O). 

(complete the following, if applicable) 

[ ] The enclosed drawing(s) are photograph(s), and there is also attached a "PETITION 

TO ACCEPT PHOTOGRAPH(S) AS DRAWING(S)." 37 CFR 1.84(b). 
[ ] formal 
[X] informal 

B. Other Papers Enclosed X 

Pages of declaration and power of attorney 2 

Pages of abstract 1 

Other 



4. Additional papers enclosed 

[ ] Amendment to claims 

[ ] Cancel in this applications claims before calculating the filing fee. 

(At least one original independent claim must be retained for filing 
purposes.) 

[ ] Add the claims shown on the attached amendment. (Claims added have 
been numbered consecutively following the highest numbered original 
claims.) 

[ ] Preliminary Amendment 

[ ] Information Disclosure Statement (37 CFR 1 .98) 

[ ] Form PTO-1449 (PT0/SB/08A and 08B) 

[ ] Citations 
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[ ] Declaration of Biological Deposit 

[ ] Submission of "Sequence Listing," computer readable copy and/or amendment 
pertaining thereto for biotechnology invention containing nucleotide and/or 
amino acid sequence. 

[ ] Authorization of Attomey(s) to Accept and Follow Instructions from 
Representative 

[ ] Special Comments 

[ ] Other 



5. Declaration or oath (including power of attorney) 

NOTE: A newly executed declaration is not required in a continuation or divisional 
application provided that the prior nonprovisional application contained a 
declaration as required, the application being filed is by ali or fewer than all the 
inventors named in the prior application, there is no new mater in the application 
being filed, and a copy of the executed declaration filed in the prior application 
(showing the signature or an indication thereon that it was signed) is submitted. 
The copy must be accompanied by a statement requesting deletion of the names 
of person(s) who are not inventors of the application being filed. If the 
declaration in the prior application was filed under § 1 .47, then a copy of that 
declaration must be filed accompanied by a copy of the decision granting § 1 .47 
status or, if a nonsigning person under § 1 .47 has subsequently joined in a prior 
application, then a copy of the subsequently executed declaration must be filed. 
See 37 CFR §§ 1.63(d) (1)-(3). 

NOTE: A declaration filed to complete an application must be executed, identify the 
specification to which it is directed, identify each inventor by full name including 
family name and at least one given name, without abbreviation together with 
any other given name or initial, and the residence, post office address and 
country or citizenship of each inventor, and state whether the inventor is a sole 
or joint inventor. 37 CFR § 1 .63(a)(1 )-{4). 

[X] Enclosed, 

executed by (check all applicable boxes) 

[X] inventor(s). 

[ ] legal representative of inventor(s). 37 CFR 1 .42 or 1 .43 
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[ ] joint inventor or person showing a proprietary interest on behalf of inventor who 
refused to sign or cannot be reached. 

[ ] this is the petition required by 37 CFR 1 .47 and the statement required by 
37 CFR 1.47 is also attached. 

See item 13 below for fee. 

[ ] Not Enclosed. 

NOTE: Where the filing is a completion in the U.S. of an International Application 
or where the completion of the U.S. application contains subject matter in 
addition to the International Application, the application may be treated as 
a continuation or continuation-in-part, as the case may be, utilizing ADDED 
PAGE FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR 
U.S. APPLICATION CLAIMED. 

[ ] Application is made by a person authorized under 37 CFR 1 .41 (c) on behalf of 
all the above named inventor(s). 

(The declaration or oath, along with the surcharge required by 37 CFR 1.16(e) 

can be filed subsequently). 

[ ] Showing that the filing is authorized. 

(not required unless called into question. 37 CFR 1.41(d)). 
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6. Inventorship Statement 
WARNING: 

If the named inventors are each not the inventors of all the claims an explanation, including the 
ownership of the various claims at the time the last claimed invention was made / should be 
submitted. 

The inventorship for all the claims in this application are: 
[X] The same. 

or 

[ ] Not the same. An explanation, including the ownership of the various claims at the 
time the last claimed invention was made, 

[ ] is submitted. 

[ ] will be submitted. 



7. Language 

NOTE: An application including a signed oath or declaration may be filed in a language other 
than English. An English translation of the non-English language application and the 
processing fee of $1 30.00 required by 37 CFR 1 .1 7(k) is required to be filed with the 
application, or within such time as may be set by the Office. 37 CFR 1 .52(d). 

[ ] English 

[ ] Non-English 

[ ] The attached translation includes a statement translation and is accurate. 37 
CFR 1.52(d). 
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8. Assignment 

[X] An assignment of the invention to Samsung Electronics, Co., Ltd. 

[X] is attached. A separate [X] "COVER SHEET FOR ASSIGNMENT (DOCUMENT) 
ACCOMPANYING NEW PATENT APPLICATION" or [ ] FORM TO 1595 is also 
attached. 

t ] will follow. 

NOTE: "If an assignment is submitted with a new application, send two separate letters - one 
for the application and one for the assignment." Notice of May 4, 1 990 (1114 0,G. 77-78). 

WARNING: 

A newly executed "CERTIFICATE UNDER 37 CFR 3.73(b)" must be filed when a continuation-in- 
part application is filed by an assignee. Notice of April 30, 1 993, 1 1 50 O.G. 62-64. 



8. Certified Copy 



Certified copy(ies) of application(s): 



Country 


Appln. 


No. 


Filed 


* 

Country 


Appln. 


No. 


Filed 


* 

Country 


Appin. 


No. 


Filed 



* 



from which priority is claimed 

[ ] is/(are) attached 
[ ] will follow. 

NOTE: The foreign application forming the basis for the claim for priority must be referred to 
in the oath or declaration. 37 CFR 1 .55(a) and 1 .63. 

NOTE: This item is for any foreign priority for which the application being filed directly 
relates. If any parent U.S. application or International Application from which this 
application claims benefit under 35 U.S.C. 1 20 is itself entitled to priority from a prior 
foreign application, then complete item 18 on the ADDED PAGES FOR NEW 
APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATION(S) 
CLAIMED. 
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10. Fee Calculation (37 CFR 1.16) 

A. 

[X] Regular Application 
CLAIMS AS FILED 

Number Filed Number Extra Rate Basic Fee 

37 CFR 1.16(a) 

$ 760.00 

Total Claims 

(37 CFR 1.16(c)) 17 -20= 0 X $18.00 $ 0.00 

Independent Claims 

(37 CFR 1.16(b)) 2 -3= 0 X $ 78.00 $ 0.00 

Multiple dependent claim(s), 

if any (37 CFR 1.16(d)) + $260.00 $ 

[ ] Amendment canceling extra claims enclosed. 

[ ] Amendment deleting multiple dependencies enclosed. 

[ ] Fee for extra claims is not being paid at this time. 

NOTE: If the fees for extra claims are not paid on filing they must be paid or the claims 
canceled by amendment, prior to the expiration of the time period set for response 
by the Patent and Trademark Office in any notice of fee deficiency. 37 CFR 1 .1 6(d). 

Filing Fee Calculation $ 760.00 

B. 

[ ] Design Application 

($310.00-37 CFR 1.16(f)) 

Filing Fee Calculation $ 

C. 

[ ] Plant Application 

($480.00-37 CFR 1.16(g)) 

Filing Fee Calculation $ 
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11. Small Entity Statement(s) 



[ ] Statement(s) that this is a filing by a small entity under 37 CFR 1 .9 and 1 .27 is (are) 
attached. 



WARNING: 



"Status as a small entity must be specifically established in each application or patent in which 
the status is available and desired. Status as a small entity in one application or patent does not 
affect any other application or patent, including applications or patents which are directly or 
indirectly dependent upon the application or patent in which the status has been established. The 
refiling of an application under § 1 .53 as a continuation, division, or continuation-in-part (including 
a continued prosecution application under § 1 .53 (d)), or the filing of a reissue application requires 
a new determination as to continued entitlement to small entity status for the continuing or reissue 
application. A nonprovisional application claiming benefit under 35 U.S.C. 1 19(e), 120,121, or 
365(c) of a prior application, or a reissue application may rely on a statement filed in the prior 
application or in the patent if the nonprovisional application or the reissue application includes a 
reference to the statement in the prior application or in the patent or includes a copy of the 
statement in the prior application or in the patent and status as a small entity is still proper and 
desired. The payment of the small entity basic statutory filing fee will be treated as such a 
reference for purposes of this section." 37 CFR § 1.28(a)(2). 

(complete the following, if applicable) 

[ ] Status as a small entity was claimed in prior application 

/ , filed on , from which benefit is 

being claimed for this application under: 



35 U.S.C. [ ] 119(e), 
[ ] 120, 
[ ] 121, 
[ ] 365(c), 

and which status as a small entity is still proper and desired. 



[ ] A copy of the statement in the prior application is included. 



Filing Fee Calculation (50% of A, B or C above) 



NOTE: Any excess of the full fee paid will be refunded if small entity status is established 
and a refund request are filed within 2 months of the date of timely payment of a full 
fee. The two-month period is not extendable under § 1. 136. 37 CFR 1.28(a). 
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12. Request for International-Type Search (37 CFR 1.104(d)) 

(complete, if applicable) 

[ ] Please prepare an international-type search report for this application at the time 
when national examination on the merits takes place. 

13. Fee Payment Being Made At This Time 

[ ] Not Enclosed. 

[ ] No filing fee is to be paid at this time. 
(This and the surcharge required by 37 CFR 1.16(e) can be paid subsequently.) 

[X] Enclosed 

[X] Filing fee $ 760.00 

[X] Recording assignment 
($40.00; 37 CFR 1.21(h)) 

(See attached COVER SHEET FOR ASSIGNMENT 

ACCOMPANYING NEW APPLICATION) $ 40.00 

[ ] Petition fee for filing by other than all the 
inventors or person on behalf of the inventor 
where inventor refused to sign or cannot be 

reached. ($130.00; 37 CFR 1 .47 and 1 .17(i)) $ 

[ ] For processing an application with a 
specification in a non-English language. 

($130.00; 37 CFR 1.52(d) and 1.17(10) $ 

[ ] Processing and retention fee 

($130.00; 37 CFR 1.53(d) and 1.21(1)) $ 

[ ] Fee for international-type search report 

($40.00; 37 CFR 1 .21 (e)) $ 

NOTE: 37 CFR 1.21(1) establishes a fee for processing and retaining any application that is 
abandoned for failing to complete the application pursuant to 37 CFR 1 .53(f) and this, 
as well as the changes to 37 CFR 1 .53 and 1 .78(a)(1), indicate that in order to obtain 
the benefit of a prior U.S. application, either the basic filing fee must be paid, or the 
processing and retention fee of § 1 .21 (I) must be paid within 1 year from notification 
under § 53(f). 

Total fees enclosed $ 800.00 
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1 4. Method of Payment of Fees 

[X] Check in the amount of $ 800.00 

[ ] Charge Account No. 19-1995 in the amount of $ , A duplicate of this 

transmittal is attached. 

NOTE: Fees should be itemized in such a manner that it is clear for which purpose the fees 
are paid. 37 CFR 1.22(b). 



15. Authorization to Charge Additional Fees 
WARNING: 

if no fees are to be paid on filing, the following items should not be completed. 
WARNING: 

Accurately count claims, especially multiple dependent claims, to avoid unexpected high charges, 
if extra claim charges are authorized. 

[X] The Commissioner is hereby authorized to charge the following additional fees by this 
paper and during the entire pendency of this application to Account No. 19-1995 . 

[X] 37 CFR 1.16(a), (f) or (g) (filing fees) 

[ ] 37 CFR 1.16(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent claims not paid on 
filing or on later presentation must only be paid or these claims canceled by 
amendment prior to the expiration of the time period set for response by the 
PTO in any notice of fee deficiency (37 CFR 1.16(d)), it might be best not to 
authorize the PTO to charge additional claim fees, except possibly when dealing 
with amendments after final action. 

[ ] 37 CFR 1 .16(e), (surcharge for filing the basic filing fee and/or declaration on a 
date later than the filing date of the application) 

[ ] 37 CFR §§1.17(a)(1)-(5) (extension fees pursuant to § 1.136(a)). 
[ ] 37 CFR 1.17(a)(l)-(5) (application processing fees) 
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NOTE: "... A written request may be submitted in an application that is an 
authorization to treat any concurrent or future reply, requiring a petition for 
an extension of time under this paragraph for its timely submission, as 
incorporating a petition for extension of time for the appropriate length of 
time. An authorization to charge all required fees, fees under § 1 .1 7, or all 
required extension of time fees will be treated as a constructive petition for 
an extension of time in any concurrent or future reply requiring a petition 
for an extension of time under this paragraph for its timely submission. 
Submission of the fee set forth in § 1.17(a) will also be treated as a 
constructive petition for an extension of time in any concurrent reply 
requiring a petition for an extension of time under this paragraph for its 
timely submission." 37 CFR § 1.136(a)(3). 



[ ] 37 CFR 1.18 (issue fee at or before mailing of Notice of Allowance, pursuant to 
37 CFR 1.311 (b). 



NOTE: Where an authorization to charge the issue fee to a deposit account has been 

filed before the mailing of a Notice of Allowance, the issue fee will be 
automatically charged to the deposit account at the time of mailing the notice 
of allowance. 37 CFR 1.311(b). 



NOTE: 37 CFR 1.28(b) requires "Notification of any change in status resulting in loss 

of entitlement to small entity status must be filed in the application. ..prior to 
paying, or at the time of paying. ..the issue fee..." From the wording of 
37 CFR 1.28(b): (a) notification of change of status must be made even if the 
fee is paid as "other than a small entity"; and (b) no notification is required if the 
change is to another small entity. 
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16. Instructions As To Overpayment 

NOTE: "... Amounts of twenty-five dollars or less will not be returned unless specifically 
requested within a reasonable time, nor will the payer be notified of such amounts; 
amounts over twenty-five dollars may be returned by check or, if requested, by credit 
to a deposit account." 37 CFR § 1.26(a). 

[X] Credit Account No. 19-1995 



[ ] Refund 



SIGNATURE OF PRACTITIONER 



Reg. No. 33,783 




Kenneth L. Sherman 



Tel. No. (310) 789-3200 



Type or print name of attorney 



SHERMAN & SHERMAN 
2029 Century Park East 
Seventeenth Floor 
Los Angeles, California 90067 
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CERTIFICATION UNDER 37 CFR 1.10 



I hereby certify that this New Application Transmittal and the documents referred to as attached 
therein are being deposited with the United States Postal Service on this date May 7, 1 999 in an 
envelope as "Express Mail Post Office to Addressee" Mailing Label Number 

addressed to: Box Patent Application, Assistant Commissioner for Patents, Washington, D. C. 
20231. 



Certificate of mailing (first class) or facsimile transmission procedures of 37 CFR 1.8 cannot be 
used to obtain a date of mailing or transmission for this correspondence. 



Each paper or fee filed by "Express Mail" must have the number of the "Express Mail" mailing label 
placed thereon prior to mailing. 37 CFR 1.10(b). 

"Since the filing of correspondence under § 1.10 without the Express Mail mailing label thereon 
is an oversight than can be avoided by the exercise of reasonable care, requests for waiver of this 
requirement will not be granted on petition." Notice of Oct. 24, 1996, 60 Fed. Reg. 56,439, at 
56,442. 



MICHELLE PAREL 




WARNING: 



WARNING: 
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[X] Incorporation by reference of added pages 

(Check the following item if the application in this transmittal claims the benefit of 
prior U.S. application (s) (including an international application entering the U.S. stage 
as a continuation, divisional or C-l-P application) and complete and attach the ADDED 
PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. 
APPLICATION(S) CLAIMED). 



[X] Plus Added Pages for New Application Transmittal Where Benefit Of Prior U.S. 
Application(s) Claimed 

Number of pages added 8 



[ ] Plus Added Pages for Papers Referred To In Item 4 Above 

Number of pages added 



[ ] Plus Added Pages deleting names of inventor(s) named in prior application(s) who 
is/are no longer inventor(s) of the subject matter claimed in this application. 

Number of pages added 

[ ] Plus "Assignment Cover Letter Accompanying New Application" 

Number of pages added 

[ ] Statement Where No Further Pages Added 

(If no further pages form a part of this transmittal, then end this transmittal with this 
page and check the following item) 

[ ] This transmittal ends with this page. 
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ADDED PAGE(S) FOR SPECIAL COMMENTS FOR NEW APPLICATION 

TRANSMITTAL 



o 

U 
0 

SJ 

O 

o 

0 
lii 
O 

£ 



Added page 1 
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Page 1/8 



ADDED PAGES FOR APPLICATION TRANSMITTAL WHERE 
BENEFIT OF PRIOR U.S. APPLICATION(S) CLAIMED 



NOTE: See37C.F.R.§ 1.78 . 



17. Relate Back 
WARNING: 

If an application claims the benefit of the filing date of an earlier filed application under 35 U.S.C. §§ 1 20, 
121 or 365(c) , the 20-year term of that application will be based upon the filing date of the earliest U.S. 
application that the application makes reference to under 35 U.S.C. §§ 120, 121 or 365(c) . (35 U.S.C. § 
1 54(a)(2) does not take into account, for the determination of the patent term, any application on which 
priority is claimed under 35 U.S.C. §§ 119, 365(a) or 365(b) .) For a c-i-p application, applicant should 
review whether any claim in the patent that will issue is supported by an earlier application and, if not, the 
applicant should consider canceling the reference to the earlier filed application. The term of a patent is 
not based on a claim-by-claim approach. See Notice of April 14, 1995, 60 Fed. Reg. 20,195, at 20,205. 

(complete the following, if applicable) 

[X] Amend the specification by inserting, before the first line, the following sentence: 
A. 35 U.S.C. § 119(e) 

NOTE; "Any nonprovisional application claiming the benefit of one or more prior filed copending 
provisional applications must contain or be amended to contain in the first sentence of the 
specification following the title a reference to each such prior provisional application, identifying it 
as a provisional application, and including the provisional application number (consisting of series 
code and serial number)." 37 C.F.R. § 1.78(a)(4). 

[X] "This application claims the benefit of U.S. Provisional Application(s) No(s).: 



APPLICATION NO(S). 
60/084,578 



FILING DATE 

May 7, 1998 
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ADDED PAGES FOR APPLICATION TRANSMITTAL WHERE 
BENEFIT OF PRIOR U.S. APPLICATION(S) CLAIMED 



B. 35 U.S.C. §§ 120, 121 and 365(c) 

NOTE: "Except for a continued prosecution application filed under § 1.53(d), any nonprovisional 

application claiming the benefit of one or more prior filed copending nonprovisional applications or 
international applications designating the United States of America must contain or be amended to 
contain in the first sentence of the specification following the title a reference to each such prior 
application, identifying it by application number (consisting of the series code and serial number) 
or international application number and international filing date and indicating the relationship of 
the applications. ... Cross-references to other related applications may be made when 
appropriate." (See § 1.14(a)). 37 C.F.R. § 1.78(a)(2). 



[ ] "This application is a 

[ ] continuation 

[ ] continuation-in-part 

[ ] divisional 

of copending application(s) 

[ ] Application No. filed on which is a continuation of 

Application No. filed 

[ ] International Application filed on and which 

designated the U.S." 

NOTE: The proper reference to a prior filed PCT application that entered the U.S. national phase is the 
U.S. serial number and the filing date of the PCT application that designated the U.S. 

NOTE: (1) Where the application being transmitted adds subject matter to the International Application, 
then the filing can be as a continuation-in-part or (2) if it is desired to do so for other reasons then 
the filing can be as a continuation. 

NOTE: The deadline for entering the national phase in the U.S. for an international application was 
clarified in the Notice of April 28, 1987 (1079 O.G. 32 to 46) as follows: 

'The Patent and Trademark Office considers the International application to be pending 
until the 22nd month from the priority date if the United States has been designated and 
no Demand for International Preliminary Examination has been filed prior to the expiration 
of the 1 9th month from the priority date and until the 32nd month from the priority date if a 
Demand for International Preliminary Examination which elected the United States of 
America has been filed prior to the expiration of the 19th month from the priority date, 
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provided that a copy of the international application has been communicated to the Patent 
and Trademark Office within the 20 or 30 month period respectively. If a copy of the 
international application has not been communicated to the Patent and Trademark Office 
within the 20 or 30 month period respectively, the international application becomes 
abandoned as to the United States 20 or 30 months from the priority date respectivley. 
These periods have been placed in the rules as paragraph (h) of § 1 .494 and paragraph 
(i) of § 1 .495. A continuing application under 35 U.S.C. 365(c) and 1 20 may be filed 
anytime during the pendency of the international application." 

[ ] "The nonprovisional application designated above, namely application 

/ , filed , claims the benefit of 

U.S. Provisional Application(s) No(s).: 



APPLICATION NO(S).: FILING DATE 



/ 



/ 



/ 



[ ] Where more than one reference is made above, please combine all references 
into one sentence. 



1 8. Relate Back--35 U.S.C. § 1 1 9 Priority Claim for Prior Application 

The prior U.S. application(s), including any prior International Application 
designating the U.S., identified above in item 17B, in turn itself claim(s) foreign 
priority(ies) as follows: 



Country Appln. No. Filed on 
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The certified copy(ies) has (have) 

[ ] been filed on , in prior application 0 / , which was filed 

on . 

[ ] is (are) attached. 

WARNING: 

The certified copy of the priority application that may have been communicated to the PTO by the 
International Bureau may 

not be relied on without any need to file a certified copy of the priority application in the continuing 
application. This is so because the certified copy of the priority application communicated by the 
International Bureau is placed in a folder and is not assigned a U.S. serial number unless the national 
stage is entered. Such folders are disposed of if the national stage is not entered. Therefore, such certified 
copies may not be available if needed later in the prosecution of a continuing application. An alternative 
would be to physically remove the priority documents from the folders and transfer them to the continuing 
application. The resources required to request transfer, retrieve the folders, make suitable record 
notations, transfer the certified copies, enter and make a record of such copies in the Continuing 
Application are substantial. Accordingly, the priority documents in folders of international applications that 
have not entered the national stage may not be relied on. Notice of April 28, 1987 (1079 O.G. 32 to 46). 



1 9. Maintenance of Copendency of Prior Application 

NOTE: The PTO finds it useful if a copy of the petition filed in the prior application extending the term for 
response is filed with the papers constituting the filing of the continuation application. Notice of 
November 5, 1985 (1060 O.G. 27). 

A. [ ] Extension of time in prior application 

(This item must be completed and the papers filed in the prior application, if the 
period set in the prior application has run.) 

[ ] A petition, fee and response extends the term in the pending prior application 
until . 

[ ] A copy of the petition filed in prior application is attached. 



Conditional Petition for Extension of Time in Prior Application 
(complete this item, if previous item not applicable) 
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[ ] A conditional petition for extension of time is being filed in the pending prior 
application. 

[ ] A copy of the conditional petition filed in the prior application is attached. 



20. Further Inventorship Statement Where Benefit of Prior Application(s) Claimed 
(complete applicable item (a), (b) and/or (c) below) 

(a) [ ] This application discloses and claims only subject matter disclosed in the 

prior application whose particulars are set out above and the inventor(s) 
in this application are 



[ ] the same. 



[ ] less than those named in the prior application. It is requested that 
the following inventor(s) identified for the prior application be 
deleted: 



(type name(s) of inventor(s) to be deleted) 

(b) [ ] This application discloses and claims additional disclosure by amendment 
and a new declaration or oath is being filed. With respect to the prior 
application, the inventor(s) in this application are 

[ ] the same. 

[ ] the following additional inventor(s) have been added: 



(type name(s) of inventor(s) to be added) 



(c) The inventorship for all the claims in this application are 
[X] the same. 

[ ] not the same. An explanation, including the ownership of the various 
claims at the time the last claimed invention was made 

[ ] is submitted. 
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[ ] will be submitted. 



21 . Abandonment of Prior Application (if applicable) 

[ ] Please abandon the prior application at a time while the prior application is 

pending, or when the petition for extension of time or to revive in that application 
is granted, and when this application is granted a filing date, so as to make this 
application copending with said prior application. 

NOTE: According to the Notice of May 13, 1983 (103, TMOG 6-7), the filing of a continuation or 

continuation-in-part application is a proper response with respect to a petition for extension of time 
or a petition to revive and should include the express abandonment of the prior application 
conditioned upon the granting of the petition and the granting of a filing date to the continuing 
application. 



22. Petition for Suspension of Prosecution for the Time Necessary to File an Amendment 
WARNING: 

"The claims of a new application may be finally rejected in the first Office action in those situations where 
(1) the new application is a continuing application of, or a substitute for, an earlier application, and (2) all 
the claims of the new application (a) are drawn to the same invention claimed in the earlier application, 
and (b) would have been properly finally rejected on the grounds of art of record in the next Office action if 
they had been entered in the earlier application." M.P.E.P., § 706.07(b) , 6th ed. t rev. 2. 

NOTE: Where it is possible that the claims on file will give rise to a first action final for this continuation 

application and for some reason an amendment cannot be filed promptly (e.g., experimental data 
is being gathered) it may be desirable to file a petition for suspension of prosecution for the time 
necessary. 

(check the next item, if applicable) 

[ ] There is provided herewith a Petition To Suspend Prosecution for the Time 
Necessary to File An Amendment (New Application Filed Concurrently) 



23. Small Entity (37 C.F.R. § 1.28(a) ) 

[ ] Applicant has established small entity status by the filing of a statement in parent 
application / on . 
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[ ] A copy of the statement previously filed is included. 
WARNING: 

See 37 C.F.R. § 1.28(a) . 
WARNING: 

"Small entity status must not be established when the person or persons signing the ... statement can 
unequivocally make the required self-certification." M.P.E.P., § 509.03, 6th ed., rev. 2, July 1996 
(emphasis added). 

24. NOTIFICATION IN PARENT APPLICATION OF THIS FILING 
[ ] A notification of the filing of this 

(check one of the following) 
[ ] continuation 
[ ] continuation-in-part 
[ ] divisional 

is being filed in the parent application, from which this application claims priority 
under 35 U.S.C. §120. 
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NOTE: The Notice of August 1, 1986, 1069 O.G. 40, states: 

"NEW APPLICATIONS-Payment of Processing and Retention Fees-- An application, 
which has become abandoned pursuant to 37 C.F.R. § 1 .53(d) for failure to pay the filing 
fee, will be disposed of unless the processing and retention fee set forth in § 1 .21 (I) is 
paid within the 1-year period referred to in § 1 .53(d) . Moreover, the processing and 
retention fee must be timely paid in order to obtain certified copies of the application (e.g., 
for convention priority purposes) or to establish a later filed application the filing date 
benefit of an earlier copending application under 37 USC 120 and 37 C.F.R. § 1 .78(a)(3) . 
Therefore, an application which has become abandoned for the reasons set forth above 
should be immediately reviewed in order to timely determine the advisability of submitting 
a processing and retention fee payment. 

"Direct any questions reagarding this helpful hint to: 
"Al Lawrence Smith 
"Director, Group 350 
"(703) 557-3414 
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Cross-references to Related Applications 

Applicant claims the benefit of U.S. Provisional Application No. 60/084,578 
entitled "Command and Control Using XML", filed on May 7, 1998 which is 
incorporated herein by reference. The present application is related to the following 
copending applications that are commonly assigned and which are incorporated 
5 herein by reference: U.S. Patent Application Serial No. 09/104,299, entitled 

"Browser Based Command and Control Home Network"; U.S. Patent Application 
Serial No. 09/104,297, entitled "Method and Apparatus for A Home Network Auto- 
Tree Builder"; U.S. Patent Application Serial No. 09/104,298, entitled "Improved 
Home Network, Browser Based, Command and Control"; U.S. Patent Application 
10 Serial No. 9/103,469, entitled "Method and Apparatus for Creating Home Network 
Macros"; and U.S. Patent Application Serial No. 09/104,606, entitled "Programming 
S Tool For Home Networks. 

jjj Field of the Invention 

13 The present invention relates to the field of network systems, and more 

7l5 particularly, to home network having multiple devices connected thereto. 

O Background of the Invention 

J A network generally includes a communication link and various devices with 

s ' y communication capability connected to the communication link. The devices include 
computers, peripheral devices, routers, storage devices, and appliances with 
20 processors and communication interfaces. An example of a network is a home 
network for a household in which various devices are interconnected. A usual 
household can contain several devices including personal computers and home 
devices that are typically found in the home. As such the term "device" typically 
includes logical devices or other units having functionality and an ability to exchange 
25 data, and can include not only all home devices but also general purpose 

computers. Home devices include such electronic devices as security systems, 
theater equipment, TVS, VCRs, stereo equipment, and direct broadcast satellite 
services or (DBSS), also known as digital satellite services (DSS), sprinkler systems, 
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lighting systems, micro waves, dish washer, ovens/stoves, washers/dryers, and a 
processing system in an automobile. 

In general, home devices are used to perform tasks that enhance a 
homeowner's life style and standard of living. For example, a dishwasher performs 
5 the task of washing dirty dishes and relieves the homeowner of having to wash the 
dishes by hand. A VCR can record a TV program to allow a homeowner to watch a 
particular program at a later time. Security systems protect the homeowner's 
valuables and can reduce the homeowner's fear of unwanted entry. 

Home devices, such as home theater equipment, are often controlled using a 
10 single common control unit, namely a remote control device. This single common 
3 control unit allows a homeowner to control and command several different home 
S devices using a single interface. Thus, may manufacturers have developed control 
2 units for controlling and commanding their home devices from a single interface. 

]f " One drawback associated with using the remote control unit to command and 

: ;:i5 control home devices is that it provides static and command logic for controlling and 
O commanding each home device. Another drawback associated with using remote 

S control units is that known remote control units cannot control a plurality of diverse 
y devices, and more particularly, cannot control a plurality of devices having different 

capabilities to communicate with each other in order to accomplish tasks or provide 
20 a service. 

In conventional network systems a user provides commands using a remote 
control unit or device control panel. Once the user ceases, there is no controller unit 
or device in the network to provide commands for automatic operation. After a user 
initially controls and commands a first set of devices, conventional systems do not 
25 provide a mechanism for the first set of devices to automatically communicate with a 
second set of devices in the network as necessary in order to accomplish tasks 
without direct user control and command of the second set of devices. Further, 
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conventional systems do not provide an efficient method for various network devices 
to obtain information about other network devices in the network for command and 
control. 



jhere is, therefore, a need for a method and a system which provides 
5 dynamic control and command devices in a home network. There is also a need for 
such a method and system to provide the ability to control a plurality of diverse 
devices having different capabilities to communicate with each other in order to 
accomplish tasks or provide a service. There is also a need for such a method and 
system to provide the ability for various network devices to automatically command 
10 and control other various network devices. There is also a need for such a method 
and system to provide universally accessible command and control information for 
■=13 inter-device communication. 

2 Summary of the Invention 

O The present invention satisfies these needs. In one embodiment the present 

7 15 invention provides a method and system for performing a service on a home 
y network, by: connecting a first and a second home device to the home network; 
O providing a database including a plurality of application interface description data 
=J objects, where each application interface description data object includes 

m information in a structured format for commanding and controlling of a home device 
20 by one or more other home devices connected to the network; the second home 
device accessing a first application interface description object for the first home 
device in the database; the first home device accessing a second application 
interface description object for the second home device in the database; sending 
control and command data from the first home device to the second home device 
25 utilizing the second application interface description object over the network; and 
sending control and command data from the second home device to the first home 
device utilizing the first application interface description object over the network. 
Whereby, the first and second home devices perform said service. 
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In one version of the invention, the first home device stores first application 
interface data therein, and the second home device stores second application 
interface data therein. The database is formed by querying the first and second 
home devices to transfer said application interface data for the first and second 
home devices to the database device. The database can be stored in a database 
device and connected to the network for universal access by network devices. In 
that case, the first application interface description object for the first home device 
can be provided from the data base to the second home device over the network. 
Further, the second application interface description object can be provided from the 
data base to the first home device over the network. 

Further, three or more home devices can be connected to the network, 
wherein at least one home device accesses the database to query the application 
interface description objects of a plurality of home devices for sending command 
and control data to the plurality of home devices over the network. Each application 
interface description object can include data in a structured format. The structured 
format can include XML format. 

Brief Description of the Drawings 

These and other features, aspects and advantages of the present invention 
will become better understood with regard to the following description, appended 
claims and accompanying drawings where: 

Figure 1 shows a block diagram on an embodiment of a network according to 
one aspect of the present invention; 

Figure 2 shows the block diagram of Figure 1 in an example device control 
and communication scenario; 

Figure 3 shows a block diagram of an example home network system 
according to the present invention which includes a plurality of client and server 
devices; 

Figure 4 shows a block diagram of example embodiments of a client device 
and a server device of Figure 3; 



Figure 5 shows example embodiments of client devices; 
Figure 6 shows example embodiments of server devices; 
Figure 7 shows a block diagram of two example networked server devices 
capable of communication with, and control of, one another; 
5 Figure 8 shows a block diagram of an example architecture of an audio/video 

(A/V) model including examples of a source server device, a sink server device and 
a client device in a network; 

Figure 9 shows another example audio/video (A/V) model; 
Figure 10 shows an example capabilities data table for a network device; 
10 Figure 1 1 shows an example attribute data table for a network device; 

Figure 12 shows an example configuration of building blocks for generating 
command messages among networked devices; 
=0 Figure 13 shows another example configuration of the building blocks of 

p Figure 12 for generating command messages; 

,2i5 Figure 14 shows three examples of interaction among networked client and 

y server devices; 

Figure 15 shows an example block diagram for definitions of API extensions 
in of networked device interfaces; 

13 Figure 16 shows an example architecture for a server device application 

Cao accessing the interface description document of another server device; 

Figure 17 shows another example inter-device control architecture between a 
controller server device and a controlled server device; 

Figure 18 shows an embodiment of an XML protocol providing a Web 
standard common middleware layer in a communication stack at the API level 
25 between networked devices; 

Figure 19 shows another embodiment of server device to server device 
command and control architecture; 

Figure 20 shows the relationship between a device interface library and 
consumer electronics definition data base for home devices; 
30 Figure 21 shows hierarchal form of an embodiment of a device interface 

definition; 
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Figure 22 shows an example of layers in device interface definition of Figure 

21; 

Figure 23 shows a command transmission and interpretation process 
between a sender and receiver device; and 

Figure 24 shows an example table of a partial list of packet types and formats 
for providing translation services according to an aspect of the present invention. 

Detailed Description of the Invention 

In one aspect, the present invention provides inter-device communication in a 
network such as a home network. As home devices become more intelligent and 
can share information, inter-device communication allows a user to interconnect 
devices in a network to take advantage of the information sharing capabilities of 
those devices. As such, inter-device communication plays a crucial role in affording 
a user with the ability to fully and flexibly utilize the networked devices. 

Referring to Figure 1, in an embodiment of the present invention, a network 
10 includes at least one client device 12 and at least one server device 14 
interconnected via a communication link 16. The communication link 16 can include 
a 1394 serial bus providing a physical layer (medium) for sending and receiving data 
between the various connected home devices. The 1394 serial bus supports both 
time-multiplexed audio/video (AA/) streams and standard IP (Internet Protocol) 
communications. In certain embodiments, a home network uses an IP network layer 
as the communication layer for the home network. However, other communication 
protocols could be used to provide communication for the home network. 

Each client device 12 may communicate with one or more server devices 14 
in the network 10. Further, each server device 14 may communicate with one or 
more other server devices 14, and one or more client devices 12, in the network 10. 
Each client device 12 can include a user communication interface including input 
devices such as a mouse and keyboard for receiving user input, and a display for 
providing a control user interface for a user to interact with the networked devices. 



The user interface can include a graphical user interface (GUI) display 18 for 
providing information to the user. Referring to Figure 2, as defined herein, each 
server device 14 provides a service for the user, except control user interface, and 
each client device 12 provides control user interface for user interaction with the 
5 network 10. As such, only client devices 12 interact directly with users, and server 
d ev j ces 14 interact only with client devices 12 and other server devices 14. 
Example services can include MPEG sourcing/sinking and display services. 

Figure 3 shows a block diagram of an example home network 10 that 
includes a plurality of client devices 12 and a plurality of server devices 14. Each 
10 server device 14 may include hardware as a resource in the network for providing 
services to the user. Further, each server device 14 may store a server or service 
5 control program 20 for controlling the server hardware, and include a graphical 
J2[ control object (GCO) user interface description 22 for user interface with the server 

j{ control program 20 as shown in Figure 4. 

J 15 For control between a controlling client device 12 and a controlled server 

J-j device 14, the client device 12 accesses the GCO 22 of the server device 14 by, for 

O example, transferring the GCO 22 from the server device 14 to the client device 12 

=£3 over the network. The client device 12 then uses the transferred GCO 22 to create 
y a control user interface GUI 1 8 for the user to communicate with the control program 
20 20 of the server device 14 from the client device 12 over the network. The user 

provides command and control to at least the control program 20 of the server 

device 14 from the client device 12. * 

Storing the GCO 22 of each server device 14 in the server device itself may 
reduce the processing and storage requirements of the client devices 12 in networks 
25 with several server devices 14. Further, storing the GCOs 22 in the server devices 
14 may allow each server device 14 to provide its own GUI look and feel to the user, 
and allows for modification or updating of the GCOs 22 without modifications to 
client devices 12. 



Referring to Figure 4, to provide command and control between a client 
device 12 and the server device 14, in one embodiment, the client device 12 can 
include a renderer 24 for displaying a GUI 18 using a GCO 22 stored in the client 
device 12 or transferred to the client device 12 over the network from a desired 
5 server device 14. For example, in an initial device selection phase, the client device 
12 can fetch the GCO 22 of at least one server device 14 over the network, and the 
renderer 24 displays a GUI 18 using the GCO 22 for controlling the server device 
14. Preferably, the GUI 18 is customized to the server device 14 and can include a 
built-in command set for controlling the server device 14. 

10 In addition, the GUIs 18 of various server devices 14 may include 

commonalities such as: (1) a common GCO model type for the client device 
03 renderer 24 to display GUIs 1 8, (2) common communication protocols for 
S transferring the GCOs 22 from various server devices 14 to the client device 12, and 
(3) common communication protocols for GUI interaction from the client device 12 to 
Ql5 the control program 20 of the corresponding server device 14, wherein the client 
T device 12 does not require a built-in knowledge of a particular server device 14 
hi being controlled. 

bfj Referring still to Figure 4, a server device 14 may include one or more server 

y control programs 20 to control the server hardware for providing a service. The GUI 
20 interface 1 8 from the GCO 22 of the server device 14 provides interface to the 

server device control programs 20. The server device 14 may also include control 
state data 26 indicating the control status of the server device 14 and server device 
hardware in providing a requested service. 

For example, the control state data 26 can include the status of control 
25 information in the GUI 18 for the server device 14, such as timer setup for a 

recording action in a VCR server device. The control state data 26 is stored in the 
controlled server device 14, and displayed to a user through the GUI 18 of the 
server device 14 at the controlling client device 12, for user control of the server 
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device 14. Preferably, the controlling client device 12 for displaying the GUI 18 of 
the server device 14 does not retain knowledge of the control state data 26 for the 
controlled server device 14. 

Each server device 14 can be controlled by one or more client devices 12. 
As such, the control state data 26 stored in the server device 14 includes status of 
the information in the GUI 18 of the server device 14 at each of the controlling client 
devices 12. For example, when the user controls a server device 14 using a first 
client device 12, upon completion of the user control, the information in the GUI 18 
of the server device 14 at the first client device 12 is saved by the server device 14 
in the control state data 26 of the server device 14. 

Alternatively, while the user is interacting with the GUI 18 of the server device 
14 at the first client device 12, the control state data 26 of the server device 14 is 
updated with the information in the GUI 18 of the server device 14 at the first client 
device 12, and upon completion of user control, the control state data 26 is retained 
in the server device 14. When the user controls the server device 14 using a 
second client device 12, the control state data 26 is made available to the user via 
the GUI 18 of the server device 14 at the second client device 12 for further control. 
The user can also use the first client device 12 at a later time to control the server 
device 14, whereupon the control state data 26 is made available to the user via the 
GUI 18 of the server device 14 at the first client device 12 for further control. The 
server device 14 can also include a clock 28, or maintains the current time, to allow 
time delay action based on time or clock input from a user, as described below. 

A client device 12 and a server device 14 can be physically bundled together 
as one unit such as a DTV. In that case, the server device 14 includes a control 
program 20 for controlling the server hardware, and the client device 12 provides 
control user interface to the server control program 20 for control and command of at 
least the server hardware. Figure 5 shows examples of client devices 12 that may 
include: (1 ) a PDA(RemoteC) for displaying a GUI, (2) a DTV(STB) for displaying a 
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GUI and including a sink server comprising audio and/or video program streak 
destination server, and (3) a PC for displaying a GUI and including at least one 
server device for providing multiple services. Hardware and executables in a DTV or 
PC client device can also be controlled by other client devices. Figure 6 shows 
example server devices 14, including: (1) a DVDP SmartCard as a source server 
device, (2) an Audio Amplifier as a sink server device, (3) a DVCR as either a source 
or a sink server device, and (4) a Management Server for managing remote server 
devices. The Management Server can be included in a DBS-STB, Cable TV-STB, 
or ATSC-STB, for example. Such devices include a Management Server for local 
control or management of the internal workings of the STB. Further, external 
servers accessed through an external network can be utilized by local client devices 
for services such as Video-on-Demand, Enhanced-TV, and Internet commerce, for 
example. 

Referring to Figure 7, communication and control between two server devices 
14 is accomplished by the control programs 20 of the server devices 14 
communicating command and control data therebetween. A server device 14 can 
control one or more other server devices 14 over the network. And, a server device 
14 can be controlled by one or more server devices 14, and by one or more client 
d ev j ces -|2. Further, a user can utilize a client device 12 to control and command a 
first set of server devices 14, and the first set of server devices 14 can automatically 
command and control a second set of server devices 14 without user involvement, 
as necessary to perform services to the user. 

For example, for automatic time-delay operation, a user can "log on" to a 
client device 12 to control a first set of server devices 14 and specify desired 
services. The user then "logs off 1 from the client device 12. The first set of server 
devices 14 perform communication and control among themselves, and at a later 
time, one or more of server devices 14 in the first set automatically control a second 
set of server devices 14 as necessary to collectively provide the desired services 
without user involvement 
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Figure 7 shows example embodiments of two server devices 14 capable of 
communication with, and control of, one another. Each server device 14 includes a 
control program 20, a clock 28 and control state data 26 described above. Each 
server device 14 can also include a GCO 22 for the server device 14 to be directly 
controlled by a client device 12. However, a GCO 22 does not need to be included 
in a server device 14 that is not directly controlled by a client device 12 and only 
communicates with other server devices 14. Each server device 14 also includes a 
command language (CL) interface 30 and a library of commands. The library of 
commands includes the commands that the server device 14 utilizes to send and 
receive information for providing its service. However, a command language is not 
necessary for user control as shown in Figure 4 and described above. 

Figure 8 shows an example audio/video (AN) model including a source 
server device 14, a sink server device 14 and a client device 12 in the network. The 
source server device 14 includes a control program 20 for controlling data stream 
source hardware 32 of the source server device 14, and the sink server device 14 
includes a control program 20 for controlling data stream sink hardware 34 of the 
sink server device 14. In an example operation, a user utilizes the client device 12 to 
control the source server device 14 to start the data stream source hardware 32, 
and to control the sink server device 14 to start the data stream sink hardware 34. 
Upon initiation of data transfer from the data stream source hardware 32 to the data 
stream sink hardware 34, the user can relinquish the client device 12. Alternatively, 
the user can program the initiation of the data transfer for a future time and 
relinquish the client device 12. Thereafter, the data stream source hardware 32 of 
the source server device 14 and the data stream sink hardware 34 of the sink server 
device 14 automatically initiate the data transfer at the time programmed by the 
user. 

For example, the data stream source hardware 32 can include a Tuner- 
Access Device such as a Direct Broadcast Satellite (DBS). A DBS is a multi- 
channel alternative to cable television and provides cable-like television 
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programming directly from satellites on small (18 inch to 3-foot diameter) satellite 
dishes. With DBS, several standard analog television signals are digitally 
compressed onto a single satellite transponder thereby allowing up to 200 or more 
channels receivable with a dish pointed at a fixed position in the sky. The data 
stream sink hardware 34 can include a Digital Video Cassette Recorder (DVCR) 
which comprises s digital VCR that is able to decode compressed digital video 
signals on playback. The user provides command and control data including "time- 
delay record" event data for the DVCR and a "time-delay select a program" event 
data for the Tuner-Access Device. After the time-delay, the Tuner-Access Device 
selects the desired program, and sources program data to the DVCR which receives 
and records the program data without further control actions from the user. 

Figure 9 shows another example audio/video (A/V) model including at least a 
source server device 14 SERVER1, a sink server device 14 SERVER2 and a client 
device 12 in the network 10. The client device 12 includes a session manager 36 
with a user interface for displaying selection information for a user to select and 
control the server devices 14 SERVER1 , SERVER2 and other server devices 14 
such as SERVER3 and SERVER4 (not shown). The selection information can 
include iconic symbols designated as Servl , Serv2, Serv3 and Serv4 in the session 
manger 36 for a user to select the server devices 14 SERVER1 , SERVER2, 
SERVER3 and SERVER4, respectively. The source sever device 14 SERVER1 can 
include a DVCR and the sink server device 14 SERVER2 can include a %DTV. 

In one example operation, upon selection of the server devices 14 SERVER1 
and SERVER2, the client device 12 transfers the GCO 22 of each server device 14 
to the client device and displays a corresponding GUI 18 for each of the server 
devices 14 SERVER1 and SERVER2. The user can interact with the GUI 18 of 
each server device 14 to provide command and control to the corresponding server 
device 14 for service. Each server device 14 can provide service alone or in 
combination with other server devices 14. Further, the session manager 36 
transfers control state data 26 between the GUIs 18 of the server devices 14 in the 
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client device 12 as necessary for the corresponding server devices 14 to perform a 
service. Based on the user command and control information, two or more of the 
server devices 14 can communicate command and control information therebetween 
to provide a user requested service. 

5 The session manager 36 can include a software agent which functions to 

access and display available home network services provided by various server 
devices 14 in the network 10. The software agent can additionally match the 
capabilities of various server devices 14 in the network 10 and display selection 
information for only those server devices 14 that have compatible capabilities. 
10 Further, the session manager 36 can match the selections made in the GUI 18 of 

one server device 14 to the selections in GUI 18 of another server device 18 to help 
5 the user provide meaningful command and control information to the server devices 

O In another example operation, the session manager 36 executes the software 

7 15 agent which searches the network and discovers the server devices 14 connected to 

Ji the network. The software agent also accesses capabilities data stored in each 

O server device 14 to determine the capabilities of the server devices 14 and provide 

on information about those capabilities to the user. The session manager 36 then 

y displays the selection icons Servl , Serv2, Serv3 and Serv4 for the server devices 

20 SERVER1 , SERVER2, SERVER3 and SERVER 4 as shown in Figure 9. 

The session manager 36 initially enables all the selection icons Servl, Serv2, 
Serv3 and Serv4 to allow the user to select from among all four selection icons. After 
the user selects the server device SERVER1 by clicking on the Servl selection icon, 
the session manager 36 determines that the server devices SERVER3 and 
25 SERVER 4 are incompatible in capability with the server device SERVER1 . As 
such, the session manager 36 disables the selection icons Serv3 and Serv 4 for 
server devices SERVER3 and SERVER4, respectively. The user can then click on 
the icon Serv2 to command and control the server device SERVER2. 
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As the user interacts with the GUI 18 of a selected server device 14, control 
and command information input by the user into each GUI 18 provide additional 
capabilities information which affect further server device selections by the user. For 
example, if a VCR server device 14 is selected, further action by the session 
5 manager 36 in enabling or disabling selection icons for other server devices 14 is 
affected by a user decision to play or record. 

Each server device 14 in the network has one or more service capabilities as 

discussed above by way of example with reference to the server devices in Figure 9. 

Each service capability includes sourcing or sinking of information. For example, a 
10 TV has the sinking capability of receiving video and audio streams, a VCR device 

can source (transmit) and sink (receive) video and audio signals, and a PC may be 
3 able to transmit and receive video, audio and data. Each sourcing capability has a 
X complementing, and compatible, sinking capability. Similarly, each sinking capability 
2 has a complementing, and compatible, sourcing capability. For example, a video 
as output capability of one device is complemented by a video input capability of 

another device. 

O Since each device 14 can be a source or sink for several different services on 

J the network, each device 14 stores a capabilities data table (Capabilities Table 1) as 
' y shown by example in Figure 10. The first column of Table 1 identifies the service 
20 capabilities of a device 14, and the second column identifies whether the device 14 
is a source or a sink for a corresponding service in the first column. Using the 
capabilities data Table 1 , new services can be implemented while maintaining 
compatibility with older devices. For example, if a new service is developed that is 
compatible with an older service, both the new and the old service can be entered 
25 into the capabilities data Table 1 for a device implementing the new service, 

whereby the implementing device remains compatible with older devices using the 
old service. 
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In one implementation, a Device Manager conducts a matching or 
comparison of device source and sink services. For example, the Device Manager 
can be implemented as a software agent to compare the capabilities or properties of 
various devices 14 and locate devices 14 with matching capabilities. For example, 
in a case where the service is a media stream from a first device 14 across the 
network to a second device 14, the Device Manager compares the capabilities of the 
first and second devices 14 to assist the user in making a sensible selection of the 
second device 14 which is compatible with the capabilities of the first device 14. 
The following is an example list of service capabilities for an embodiment of a server 
device 14: 

Stream_format_video_dv 
Stream_format_video_mpeg2tpt 
St rea m Jbrmat_vid eo_d sstpt 
Stream_format_video_mpeg2pes 
Stream__format_video_mpeg210801-tpt 

Each device 14 can further store an attribute data table (Attribute Table 2) 
including pertinent attributes of the device, shown by example in Figure 1 1 . A name 
and a value define each attribute within Table 2. Though character lengths are 
shown in Table 2, they are not required. The attribute data is available to other 
devices 14 on the network 10 to facilitate interoperability and to store device 
information. For example, a Device Page as described below uses the Attribute 
Table 2 to store the device name. Other fields can be added to the attribute data 
Table 2 as necessary. 

In the user-to-client device control model described above, attribute data can 
be displayed on the GUI page of the server device 14 at the client device 12. 
Alternatively, a second level device information home page can be utilized to display 
said attribute data. Further, the attribute data in the form of a text or Extensible 
Markup Language (XML) file can be accessed by a software agent. For the device- 
to-device control model, the attribute data for the controlled device is stored in the 
device interface application interface. 
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The Device Location attribute field in the Attribute Table 2 is used to store the 
location or group for each device 14. The Device Type attribute field specifies the 
device type, such as VCR, DVD, DTV, Camcorder, PC, Security System, etc. for the 
particular device 14. The Device Type attributes field is used to select a default 
device icon to represent the device within the Device Page if the device itself does 
not supply one. The Attribute Table 2 can include multiple entries for the Default 
Source and the Default Sink attributes fields. Each such entry represents a different 
default source or sink device 14 for each data type handled by the device 14. 



Preferably, the capabilities and attributes data are packaged into structured 
data using a hierarchical language. This provides a common method of retrieving 
the capabilities and attributes data that are used for other purposes such as in GCO 
transfer and server device-to-server device control. As an example, the attributes 
data can include the following structured data format: 

<DEVICEATTRIBUTES> 

<ATTRIBUTE name=DeviceManufacturer value="Samsung lnc."> 
<ATTRIBUTE name=Manufacturer URL value=www.samsung.com> 
<ATTRIBUTE name=Manufacturerlcon value="logo.gif > 
<ATTRIBUTE name=DeviceName value-'Samsung DSS"> 
<ATTRIBUTE name=DeviceModel value="SCH1900"> 
<ATTRIBUTE name=DeviceType value=DDS> 
<ATTRIBUTE name=DeviceLocation value="Livingroom"> 
<ATTRIBUTE name=Devicelcon value="device.gif> 
<ATTRIBUTE name=DeviceAddress value=105.144.30.17> 

</DEVICEATTRIBUTES> 

As an example, the capabilities data can include the following structured 
format: 

<DEVICECAPABILITIES> 

CAPABILITY type=MPEG2 value=Source> 

< CAPABILITY type=MPEG2 value=Sink> 

<CAPABILITY type=MPEG3 value=Source> 

CAPABILITY type=MPEG3 value=Sink> 
</DEVICECAPABILITIES> 
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An application interface language is utilized to allow different server devices 
14 to perform device-to-device control, including sever device-to-server device 
control. The application interface language includes command languages, and can 
be described using XML, as detailed below. The control program 20 of one server 
device 14 remotely controls the control program 20 of another server device 14 over 
the network, without using GUIs 18 or user involvement. An example of device-to- 
device control is automatic operation. A user initially provides control through a 
client device 12 for a desired service, and subsequently two or more server devices 
14 automatically communicate and control one another without further user 
interaction to provide the service. 

Referring to Figures 12 and 13, preferably a standard application interface 
language is utilized to allow interoperability among various control programs 20 in 
various server devices 14. In one embodiment, the standard application interface 
language includes the following building blocks: (1) functional specification of service 
40 such as in a service function database, (2) a block where elements of a message 
are composed 42, (3) industry standard format 44, (4) message compression 46, 
and (5) message string construction 48 to output structured message data. 

Figure 12 shows an example configuration of the building blocks to perform 
the function of generating command messages. Each message item is composed 
from the functional specification of service and standardized by selecting an industry 
standardized compressed form (Hex) label for the message item. A group of such 
message items are assembled to create a complete command string. Existing 
command languages such as CAL and AV/C operate as shown in Figure 12. 
However, such command language mechanisms specify binary or hex code 
messages and system operation on physical devices on the physical interface, and 
are based on hardware specifications. Therefore, such command languages may 
be less desirable for a network layer based control mechanism where a control 
system specification includes naming, addressing, device capability discovery, 
communication language and command messages at the application level software 
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level, where one software application program 20 in a controller device 14 locates 
and controls another software application 20 program in a controlled device 14 over 
the network 10. Said control mechanism is more suitable for devices such as digital 
appliances including appliances (e.g., DVCR) as well as multi-purpose, 
multi-application devices such as computers. 

Figure 13 shows a preferred example configuration of the building blocks of 
Figure 12 to perform the function of generating command messages. In Figure 13, 
the positions of the industry standard format 44 and the message compression 46 
are different than in Figure 12. A number of textual standard forms are selected 
from the functional specification service 40 to make a complete message. Later the 
message may be compressed by a lower layer of the protocol stack. Figure 1 3 
represents a method of performing service or device command and control for 
consumer electronics (CE). Message composition can be defined by the XML 
standard syntax and compression can be performed by another protocol layer such 
as HTTP. A command interface language is utilized at the application software 20 
interface level, rather than lower hardware levels. As such, the network protocol 
stack is governed by commands in said language, and each of a controller device 14 
and controlled device 14 can be viewed as integrated components of the network for 
message transmission therebetween. 

Referring to Figure 14, three different instances of interaction among client 
devices 12 and server devices 14 are shown. In the first instance "A", a human user 
communicates with a remote service application "S". The user utilizes a browser in 
a client device 12 as the user interface, wherein the browser controls service 
programs 20 in the service application "S" and receives response in Hyper Text 
Markup Language (HTML) or XML formats. A secondary server is included with the 
browser to accept XML based asynchronous command message postings. For 
example, for a DVCR the secondary server 14 can accept command messages 
such as "VCR FAILED: TAPE BROKE." A software agent including a browser can 
be utilized to display the command messages for a user in the browser's GUI for 
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later attention by the user and control of the DVCR. Preferably, an XML based client 
device 12 includes an HTTP1.1 server capability to respond to command initiated 
elsewhere for server device to server device command and control. 

In the second instance "B", the user is replaced by a software client control 
program 50. The software client control program 50 generates XML based 
command postings to the service application "S" and receives back XML command 
postings. And, in the third instance "C", the software client control program 50 is 
replaced by an application such a server device control program 20, wherein 
commands and responses are exchanged between two service applications 20. In 
that regard, instance "B" is a special case of instance "C" with a null service. 

An application interface language based on XML is used for control between 
a first server device 14 and a second sever device 14 (device-to-device or service- 
to-service) for devices or services that are world wide web (Web) enabled and 
Internet enabled. The application interface language is based on the Web standard, 
middleware layer. In one embodiment, device-to-device control includes remotely 
controlling the control program 20 or Application, in one server device 14 from 
another server device 14 in the network 10. As such, the interfaces (API) to such 
Applications 20 are made available over the network using API extensions. 
Preferably, the API extensions utilize a standard format, such as an XML-based 
interface, to provide overall interoperability. 

Referring now Figure 15, there is shown block diagram definitions of API 
extensions for a first Application A, designated as Service A, and a second 
Application B, designated as Service B, communicating over the network 10. For 
example, the Service A can be the control program for a first server device A in the 
network, and the Service B can be the control program for a second server device B 
in the network. The server device B sends commands to the server device A. For 
this example, the first and second service devices A and B can include CE devices. 
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Referring to the API extensions for the Service A, the first upper-most block 
52 provides a comprehensive definition or data base of CE objects and methods 
using English words to describe CE devices. The comprehensive definition or data 
base can also be in C, XML or other formats capable of representing objects and 
their respective methods. The comprehensive definition or data base utilizing XML 
is termed XCE definition. The second block 54 provides a format for representation 
of an API in XML form for all devices 14, designated as an interface data type 
definition INTERFACE.DTD. 

A software agent, designated as Tool A, utilizes a subset of the XCE 
definition for Service A, and uses the interface data type INTERFACE.DTD for 
Service A to create an XML form document, I NTE RFACE-A.XM L. The document 
INTERFACE-A.XML describes the objects and methods supported by the Service A 
according to the document type definition INTERFACE.DTD for Service A. Other 
data type definitions can also be used to create the INTERFACE-A.XML document. 

The software Tool A also creates a look-up table 56 to convert from XML 
messages from Service B on the network interface, to API definitions for Service A, 
programmed in C for example, and complied to executable binary. Preferably, the 
look-up table 56 is created at compile time, whereby during run-time, incoming XML 
form method messages (commands) from Service B are converted to the API format 
created by the complied application C code for Service A. The look-up 56 table 
provides run-time translation of XML object method calls from Service B into device 
native language calls for Service A. The look-up table 56 is complied with the 
device control program 20 for local execution on the server device A for Service A. 

The INTERFACE-A.XML can be used by Service A for validity checks if it 
encounters an error in a received message. The INTERFACE-A.XML can also be 
used by a foreign Application such as Service B to determine the message format 
for Service A before communicating with Service A. Further, if a message from 
Service B to Service A causes an error, Service B can access the INTERFACE- 
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A.XML document to diagnose the error. 



Referring to the API extensions for the Service B, the first block 58 provides a 
comprehensive definition or data base of CE objects such as the XCE definition for 
Service A above. The next block 60 provides a language definition for making XML 
5 form method (command) calls to remote API services or devices such as the API for 
Service A. The language definition is a document type definition Method Request 
CALL.DTD which describes interaction with objects on the network. 

A software agent, designated as Tool B, utilizes at least a subset of the 
objects and methods in the XCE definition for Service B and the CALL.DTD 
JO document, to generate a look-up table 62 for converting commands from a complied 
5 C program code for Service B into XML form method requests. As such, the look-up 
n table 62 provides conversion between a method invoked by Service B (e.g., "PLAY") 

11 and the XML document or message that carries the method call across the network 
C interface to Service A, for example. The subset of the XCE definition used by 
7 15 software Tool B depends on the extent and nature of use of the network. For 
S example, the subset can be selected to provide global or restricted use of all 

H available services on a home network. 

^ Therefore, the API extensions provide for communication between various 

devices on the network using XML. In the example above, the program code 20 for 
20 Service B generates method calls to an API, and the API calls are converted to XML 
form to comply with the Web/Internet standard XML for inter-device communication. 
The XML method calls (messages) are sent to Service A over the network, and 
Service A reconverts the XML method calls from the network interface to program 
code API definitions for Service A. This conversion and re-conversion provides 
25 Web/Internet compatibility for diverse devices in the network with program code 

APIs which would otherwise require binary compatibility between different devices. 
Appendix 1 shows examples of the XML interface blocks utilizing the block diagrams 
in of Figure 15. 
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Further, Appendix 1 provides examples of interface definitions 
INTERFACE. DTD and CALL. DTD used to create description documents of available 
services, I NTERFACE.XML, described above. The CALL. DTD definition includes a 
rule set for generating method call or function call message such as XML Remote 
Procedure Call (RPC) or XMLRPC messages. The CALL. DTD definition describes 
an output interface of a controller service 14. In a home network, for example, 
I NTERFACE.XML represents the services available on the home network. The 
available services are a subset of the entire services in the CE space. 

In a One-Touch-Record (OTR) scenario, a user is in control of a 
Tuner-Access-Device such as a Satellite STB. The user controls the tuning using 
an Electronic Program Guide (EPG) such as a graphical user interface 
representation of program listings. OTR record provides the user with a service 
including selection of a future program from the EPG for recording without the user 
accessing the VCR graphical user interface to program the VCR for a Time Delayed 
Recording. OTR automates the control of the VCR. Below is an example control list 
of actions in OTR.XML shown in Appendix 2: (1 ) StreamOpen = play the selected 
program stream output to the network from a Satellite STB; for OTR this control is 
local to the STB device; (2) StorageOpen = open a storage service; and (3) 
StorageRecord = Send the Record command across the network to the VCR. 

As discussed above in relation to Figure 15, a first device B can access the 
I NTERFACE.XML document of a second device A to examine the device 
capabilities and API interface details of the second device A and determine 
supported functionality and command details of the second device A. In particular, 
the first device B can determine overlapping, and therefore useable, methods 
supported by first device B and the second device A. Figure 16 shows an example 
wherein a first server device B including an Application B accesses the 
INTERFACE-A.XML document of a second server device A including an Application 
A. The first server device B includes a INTERFACE-B.XML document for 
comparison with that of a INTERFACE-A.XML document in the second server 
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device A 

In one scenario, the first server device B wishes to control the second sever 
device A in the network. The INTERFACE-A.XML document of the second device A 
is transferred from the second server device A to the first server device B and used 

5 by Application B to query the capabilities and API interface methods of the second 
server device A. This allows the first server device B to control the second server 
device A utilizing XML remote procedure calls XMLRPC. In another scenario, the 
first server device B performs the above steps after attempting to communicate with 
the second server device A at least once, and failed to establish communication. 

10 Yet in another scenario the first server device B queries the INTERFACE-A.XML 
document in the second server device A remotely without transferring the 
INTERFACE-A.XML document to the first server device 6. 



Upon examining the contents of the INTERFACE-A.XML document, the first 
O server device B can create commands for sending to the second server device A in 
7 15 XML format as described above. Generally, the first server device B can interpret at 
5 least a portion of the contents of the INTERFACE-A.XML document that overlaps 

Q with a subset of the XCE definition used by the first and second server devices B 
j and A as described above. If the first server device B is unable to interpret a portion 
s of the contents of the INTERFACE-A.XML document, then the first server device B 
20 can ignore that portion, or fetch an application to assist it in interpreting that portion, 
by translation as described further below. 

Referring to Figure 17, another example device-to-device or inter-device 
control between a controller server device 14 and a controlled server device 14 is 
shown. The controller device 14 includes a controller application E and the 
25 controlled device 14 includes an application executable C. The controlled device 14 
further includes INTERFACE-A.XML, the application interface description A of the 
application C. Application E accesses the application interface description A in the 
controlled device 14 to query the capabilities and API interface methods of the 
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controlled server device 14. Application E then commands and controls application 
C using XML remote procedure calls to control hardware or service D of the 
controlled device 14. A scheduler device can be a case of a controller device 14, 
driven by time of day such as Time-Delay-Record controller in a VCR. 

In a first example, the application £ accesses the application interface 
description A by remote query over the network. In a second example, the 
application E accesses the application interface description A by transferring a copy 
of the application interface description A from the controlled device 14 to the 
controller device 14. The application E then queries the interface description A 
locally. In a third example, the application interface description A is transferred to a 
library device 64 which provides library space for interface descriptions, and the 
application E remotely queries the interface description A in the library. The library 
device 64 stored the address (URI) of the associated applications available for direct 
control action and responses. 

Referring to Figure 18, the XML protocol provides a Web standard common 
middleware layer in a communication stack 66 at the API level between applications 
20 of various devices 14 in the network. In each device 14, applications at the top of 
the communication stack send and receive communication messages over the 
network, and communicate with software layers in the device stack that locally 
control the device hardware or service software for the device. 

A first XML layer API, designated as XML Layer OUT 68, is used for sending 
messages, and a second XML layer API, designated as XML Layer IN 70, is used 
for receiving messages. The XCE definition and the XML definition of a method call, 
namely the document type definition CALL. DTD described above, are used to create 
the XML Layer OUT 68. Further the XCE definition and the XML definition for a 
method call, namely document type definition INTERFACE. DTD described above, 
are used to create the XML Layer IN 70. For example a controller application 
utilizes the XML Layer OUT 68 and a controlled application utilizes the XML Layer 
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IN 70. 



Referring to Figure 19, another embodiment of server device-to-server device 
command and control architecture is shown. An XML-based control architecture is 
utilized for device-to-device (service to service) control for Web and Internet enabled 
devices or services. A first device A can remotely control an application 20 in a 
second device 6 over the network using XML command messages. The interface to 
each device includes interfaces to the applications in the device, and is described in 
XML format. Said interfaces can be extended and made available on the 
middleware layer for retrieval and interpretation by other devices over the network, 
as described further below. 

Each of the server devices A and B includes hardware and software for 
controlling other server devices over the network and for being controlled by other 
server devices over the network. In Figure 1 9, the home network device A is a 
controller device or module, and the home network device B is a controlled device or 
module. Each of the devices A and B includes a local Device XML Interface 72 
comprising an interface document INTERFACE.XML and a document type definition 
INTERFACE. DTD. The INTERFACE.XML document includes a description of the 
objects, methods and parameters supported by the corresponding device 14. The 
INTERFACE. DTD document can be used for validity checks specific to the XML 
interface of the device, as described above. 

Each of the devices A and B also includes an XML parser 74, comprising 
program code for parsing and validating XML messages, such as XML interface and 
XMLRPC commands. The XML parser 74 is similar to said XML Layer IN 70 
described above with reference to Figure 18. Further, each of the devices A and B 
includes an XMLRPC encoder and decoder (codec) 76 for encoding method names 
and parameters of an outgoing call in an XMLRPC message, and for decoding an 
incoming XMLRPC message after it is parsed, to retrieve the method name and 
parameters therein. The XMLRPC codec 76 is independent of the device XML 
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interface 72 and of the device-to-device control architecture, thereby allowing use of 
different XMLRPC formats without changing other aspect of the device to device 
control architecture. 

An Interface Fetcher comprising program code, is utilized by each of the 
devices A and B to fetch the device interface of another device directly from another 
device or from a home network Interface Library 80. When a device 14 is a 
controller device, a controller application program code 82 in the controller device 14 
effects command and control of other devices 14 over the network, by supervising 
software and hardware in the controller device 14 such as the XML parser 74, the 
interface fetcher 78 and the XMLRPC codec 76. When a device 14 is a controlled 
device, a controlled application program code 84 in the controlled device 14 
supervises software and hardware in the device 14 for the device 14 to be controlled 
by other devices 14. A Home Network Device Web server 86 in each of the devices 
A and B manages communication between the devices over the network. An XML 
to Native Lookup Table 88 in each of the devices A and B is used by the controlled 
application 84 to convert information in XMLRPC messages (e.g., method name, 
parameters name and type) to native interface of the device (e.g., native method 
name, parameters name and type). Said table 88 is not used when the names of 
methods and parameters in XML messages and the native interface of the device 
are the same. 

Each of device the devices A and B further includes one or more Handlers 
90, wherein each Handler 90 includes a pointer from within the controlled application 
84 to a native implementation of one specific device functionality. In most devices, 
native implementations of device functionality include binary code at run-time. The 
binary code can be generated from higher level languages at compile time, including 
C and Java, for example. As such, consumer electronics manufacturers can add 
more Handlers 90 for new functions without affecting existing Handlers and function 
implementations. A hardware service 92 in each of the devices A and 6 includes 
native implementations of device functions. Each of the devices A and B also 
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includes a Native Interface 94 which comprises the API of native implementation of 
the device functions. 

Further, a Network Object Request Broker such as a Home Network Object 
Request Broker (HNORB) 79 and Interface Library (IL) 80 provides a middleware 
5 layer 98 for the home network 10. As shown in Figure 19, the middleware layer 98 
can be located in a third device 96 or in a separate control hub. The HNORB 79 
includes a software agent for use by one device 14 to discover the existence of 
other devices 14 connected to the network 10. The HNORB software agent 
organizes device names into a naming hierarchical tree structure, organizes device 
10 interfaces into said searchable Interface Library, and provides device interfaces to a 
device requesting interface information. 

jjij The middleware layer, comprising the HNORB 79 and the IL 80, can be 

2* connected directly to the Internet, such that selected home devices can be accessed 

D from outside of a local home network 10. The middleware layer 98 in one local 

=: = 15 home network can be connected to the middleware layer 98 in other local home 

;;:[ networks over the Internet to provide an integrated network comprising two home 

H networks 10. In that case, authorized users with the appropriate stream encryption 

:fl can access a DVD changer in the user's primary home, from a TV in the user's 
secondary home to play a video and view it on the TV. 

20 To use the Interface Library 80, at least one HNORB&IL should be running on 

the local home network 10. More than one HNORB&IL may also be available. For 
example, a cable modem, several DTVs, and a central home hub can all have their 
own HNORB&IL software agents. To locate the HNORB&IL, a device 14 sends a 
broadcast message over the local home network. The first HNORB&IL to respond to 

25 the device 14 is utilized by the device 14. Once a HNORB&IL is located, the device 
14 and the HNORB&IL can establish a point-to-point Transmission Control Protocol 
(TCP) or User Datagram Protocol (UDP) connection for registration, interface 
request and fetch, and device lookup services. If a UDP protocol is not available, a 
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TCP protocol can be used for high bandwidth connections such as IEEE 1394. 
HTTP-based XMLRPC can also be utilized for device to HNORB&IL 
communications. For example, a device 14 can remotely call a "register" method of 
HNORB to pass the device interface as one or more parameters, or, a XMLRPC call 
can retrieve a partial or entire device interface from the IL as a XMLRPC response 
or return value. 

As aforementioned, more than one HNORB&ILs can run in a local home 
network 10 simultaneously, wherein each HNORB&IL recognizes a subset of 
available devices and one HNORB&IL can communicate with other HNORB&ILs to 
locate the devices 14 it can not find. Multiple HNORB&ILs on one local home 
network 10 can locate each other automatically by using broadcasting messages, 
such as UDP or TCP. In this case, multiple HNORBs construct a distributed object 
request broker, while multiple Interface Libraries 80 construct a distributed interface 
library. To provide fault tolerance, if one of the HNORB&IL should terminate 
unexpectedly, all devices registered with this HNORB&IL are notified and said 
devices can automatically register with another available HNORB&IL. 

Each device interface has an associated consistent, unique logical name. 
Other devices can use said consistent, unique, logical name to recognize and 
access a device, even after said device's location or real network address has 
changed. The mapping of the logical names and real device addresses are handled 
by a software agent for naming service in HNORB. Preferably, a standardized 
naming method is utilized. More preferably, a hierarchical naming structure is used 
to organize device names into a hierarchical tree. This hierarchical structure can be 
expressed using 7", similar to that in a file system. The structure can be generated 
by different methods, such as by different service types as a home/MPEG2/TV; or 
by different locations, such as home/livingroom/VCR. Several naming trees may 
coexist for performance and efficiency. 
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In the example command and control between the controller server device A 
and the controller server device 6 in Figure 19, the middleware layer 98 is in the 
third device 96 or can be in a separate central hub. The grayed blocks show the 
device elements used for the specific command and control process depicted in 
Figure 19. In an example operation scenario, after the devices A and B become 
available and accessible over the network, each device registers/submits itself and 
its XML interface to the central HNORB and IL middleware layer 98. If a central 
HNORB and IL middleware layer is not available, then each device broadcasts a 
message over the local home network to announce itself. 

The controller application 82 of the device A attempts to query all or part of 
the device interface of the controlled device B. If an Interface Library 80 is not 
available, the controller device A can request and fetch the device interface of the 
controlled device 6 directly from the controller device B by first sending a request to 
device B over the network, and then receiving the XML interface of device B from 
the device B. However, if an Interface Library 80 is available, the controller device A 
can request all or part of the device interface of the controlled device B from the 
Interface Library 80. The software agent of HNORB obtains the XML device 
interface of the device B from the Interface Library 80 structure and sends it back to 
the controller device A. 

Once the controller device A receives the XML device interface of the 
controlled device B, the controller application of device A uses the XML parser 74 of 
device A to parse and interpret the device interface of the device B. The XMLRPC 
codec 76 of device A then generates desired XMLRPC command messages using 
the parser results. The XMLRPC command messages are sent to the controlled 
device B over the network. Upon receiving said XMLRPC command messages, the 
controlled application 84 of device B uses the XML parser 74 of device B to parse 
and interpret the received XML command messages. The XMLRPC codec 76 of 
device 6 then decodes the parser results to obtain the method call information in the 
command message, including a method name and parameters for the device S 
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functions to perform requested services. 



The controlled application 84 of device B then uses the XML to Native Lookup 
Table 88 and Handlers 90 in the device B to access and launch the native function 
implementations of device B through the native interface of device B. If a function 
generates any responses or return values, said responses or return values are 
encoded into XML or XMLRPC messages and sent to the controller device A 
Further, the middleware layer HNORB and IL can provide the controller device A 
with a reference to the controlled device B, whereby the device A can generate 
remote calls to the device B native functions just as calls to the local device A native 
function. 



Preferably, a standard XMLRPC format is utilized so that all devices can 
interpret and decode RPC calls over the network. Because the device interface of a 
controlled device 14 can be queried and examined by a controller device 14, 
preferably a simplified XMLRPC format with sufficient device interface information is 
utilized to improve efficiency. The following example shows two possible formats of 
XMLRPC calls for One Touch Record (OTR) and Time Delayed Record (TDR) 
operations. 

EXAMPLE I : 

XML RPC call, example format including detailed tag and interface information: 
1. Example of OTR call: 
<?xml version="1 .0"?> 
<call> 

<object>DVCR1 . record </object> 
<method>timeDeIayedRecod</method> 
<parameters> 
<parameter> 

<name>channel</name> 
< val u e>< i nt>4</i nt></val ue> 

</parameter> 
<parameter> 

<name>recordTime</name> 
<value><time>2:10:30</time></value> 

</parameter> 
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</parameters> 

</calI> 

2. Example of TDR call: 
<?xml version="1 .0"?> 
<call> 

<object>DVCR1 .record</object> 
<method>oneTouchRecod</method> 
<parameters> 
<parameter> 

<name>channel</name> 

<value><channeIName>NBC</channeIName></value> 

</parameter> 
<parameter> 

<name>startTime</name> 

<value><datetime.iso8601>1 9990401 T19:05:35</datetim 
e.iso8601></value> 

</parameter> 
<parameter> 

<name>recordTime</name> 
<value><time>2:00:00</time></value> 

</parameter> 

</parameters> 

</calI> 
EXAMPLE II: 

XML RPC call, example format with reduced tags and interface information: 

1. Example of OTR call: 
<?xml version="1 .0"?> 
<call> 

<object>DVCR1 .record</object> 

<method>timeDelayedRecod</method> 

<parameter value="4">channel</parameter> 
<parameter value="2:10:30"> recordTime </parameter> 

</call> 

2. Example of TDR call: 
<?xml version- '1 .0"?> 
<call> 

<object>DVCR1 . record </object> 
<method>oneTouchRecod</method> 

<parameter value="NBC">channel</parameter> 

<parameter 

value="1 9990401 T19:05:35">startTime</parameter> 
<parameter value="2:00:00">recordTime</parameter> 

</call> 
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Referring to Figure 20, device interfaces for home devices 14 are based on 
an industry standard structured data base 100 using standardized vocabulary. 
Interface data for new interfaces and vocabulary can be added to the data base 100. 
A comprehensive definition or database of CE objects, methods and parameters 
using English words to describe all CE devices is termed a CE data base 102. The 
comprehensive definition or database can be in C, XML or other formats capable of 
representing objects and their respective methods and parameters. The 
comprehensive definition or database utilizing standardized XML vocabularies is 
termed XCE definition or data base 104. 

Controller and controlled applications 82, 84 are programmed using a 
standard interface subset of the XML based XCE data base 104. Each device 
interface is stored with said applications 82, 84 in XML form. Although the XCE data 
base 104 need not be in XML, said subset interface produced at compile time is in 
XML in an embodiment of the invention, as described above in reference to Figure 
15. 

In Figure 20, for embedded appliances 14, the information designated as 
'Manufacturer' information is built-in to the appliances 14 at manufacture time, and 
the information designated as 'Home Network 1 is part of the operational run time 
aspects of the appliance in the network. Device XML interfaces 72 designated as 1 
... N for N devices 14, are branches of the data in a standardized XCE data base 
104. A Home Network Interface Library (HNIL) 106 provides a collection of the 
device interfaces of available devices 14 connected to the home network. The 
Home Network Interface Library 106 is a subset of the totality of the XCE data base 
104. 

In Figure 16, a device interface was transferred from a device A to a device B 
for an Application B in device B to examine the contents of the interface for the 
device A. As detailed above, a device interface includes a description of the 
objects, methods, parameters supported by a device, and is referred to as 
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INTERFACE-A.XML for a device A for example. A Device XML interface 72 is a 
device interface in XML format. The content of the XCE data base 104 is a service 
oriented structure which provides device interfaces. 

Referring to Figure 20, the XCE database 104 also includes a standardized 
XCE Interface Document Type Definition (DTD) for CE devices, which provides a 
standardized set of rules for using XML to represent CE devices 14. The DTD or its 
subsets can be used for validity checks. A software agent designated as 
Manufacturer Tool 108, filters and utilizes a subset of the standardized XCE 
definition 104 for a specific CE device, and uses the standardized XCE Interface 
DTD to generate an XML device interface 72 of the CE device, for example 
INTERFACE.XML and INTERFACE. DTD. The document INTERFACE.XML 
includes a description of the objects, methods and parameters supported by a 
specific device according to the standardized XCE Interface DTD. The document 
INTERFACE. DTD is a subset of the standardized XCE Interface DTD, and can be 
used for validity check for the XML interface of the device. Other document type 
definitions can also be used to create the INTERFACE.XML document. 

The XML interfaces 72 of the CE devices, including said XML interface 
document and said DTD document, are stored in a universally accessible library 
such as the home network Interface Library 106. A software agent 110 collects the 
device interfaces 72 of all accessible devices 14 over the network and places them 
into the searchable structured Interface Library 106 along with the device 
name/address information. The Interface Library 106 is a subset of the XCE 
database 104 and the process of generating the Interface Library 106 is similar to 
that of rebuilding part or all of the XCE database 104. The Interface Library 106 can 
function as a collection of device interfaces 72 of all devices 14 in the home network, 
or as a cache depending on availability of storage space, wherein only the most 
recently used device interfaces 72 are stored therein. In cases where a device 14 
updates its device interface 72 due to an event, such as disk change in a DVD 
player, part of the device interface 72 is updated based on an event service. 
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Referring to Figure 21 , preferably the device interface definition 72 of each 
device 14 has a hierarchical form. This is because for a home device 14, the device 
interface definition 72 can be lengthy. Typically, one or few functions such as a 
single function for Time Delayed Recording, are accessed at a time, and therefore 
only a small portion of the device interface 72 is used. Rather than rendering the 
entire device interface 72, it is more efficient to render only a portion of he device 
interface 72. By using hierarchical device XML interface, a controller device 14 can 
request partial device interface 72 of a controlled device 14 by specifying the desired 
function categories or functions in a request for the XML device interface from the 
controlled device 14 or from the HNORB and IL middleware layer 98. In the latter 
case, the HNORB and IL middleware layer 98 sends back the desired portion of the 
device interface 72. 

Referring to Figure 21, the hierarchical device interface structure can include 
four layers, including: (1) a first layer 112 for XML interface of each home network, 
listing current available devices, (2) a second layer 1 14 for general XML interfaces 
of each device, listing function categories, (3) a third layer 1 16 for specific XML 
interface of each function category for a device, and (4) a fourth layer 1 18 for 
specific XML interface of each function in a function category. Inside the home 
network, only the three lower layers 114, 116 and 118 are utilized, and outside the 
home network the first layer 1 12 is utilized. 

Figure 22 shows said layers 1 12, 1 14, 1 16, 1 18 and corresponding interface 
examples. The interface in each layer is linked to upper or lower layer (if available) 
through links such as XLink or XPointer, which provide two-way linking. XLink 
includes a package of hyperlinking functionality that has two parts: (1) an XLink 
component which allows links in an XML documents to be recognized as such, and 
(2) an XPointer component which allows links to address into precise sub-parts of an 
XML document. As such, XLink governs how links are inserted into XML 
documents, wherein the link may point to data such as a GIF file. Further, XPointer 
governs a fragment identifier that can go on a URL when linking to an XML 
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document, from anywhere (e.g., from an HTML file). 

In a typical command and control model for a server device 14 to control 
another server device 14 according to the present invention, a first device 14 
attempts to query the device interface of a second device 14 at the second interface 
layer 1 14. After selecting function categories (FC), the first device 14 queries the 
interface layer 1 16 of a specific function category in the second device 14, such as 
Record Category. Further, the first device 14 can query the interface layer 1 18 of a 
specific function, such as OTR or TDR, to make calls to said functions. The 
hierarchical or tree structure makes finding of an interface function more efficient 
and saves network bandwidth. An example interface file structure and layers can 
be: 

First layer 112- HNI.xml 

Second layer 1 14 - VCR1 .xml 

Third layer 1 16 - VCR1_RecordCategory.xml 

Fourth layer 1 1 8 - VCR1 JRecordCategoryJDTR.xml 

Similarly, the home network Interface Library 106 is preferably hierarchical 
and can be structured in a variety of ways such as by different service type of 
devices or by different locations such as rooms. Said hierarchical structure is the 
interface of a local home network 10 to other home networks or the Internet. 

Appendix 5 shows an example hierarchical device interface definition 72 
which can be implemented in XML syntax. Said hierarchical device interface 
definition 72 can include the following fields: 

'document file' name, provides name of the document type definition 
(DTD) file that can be used by an XML parser 74 for verification of legality and 
correctness of the XCE database 104 or part of the XML version of the XCE 
database 104. There can be several DTD files for different parts of the XCE 
structure, wherein said DTDs are different from the document type definitions for the 
RPC.CALL and INTERFACE. DTD for communication. 
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'doc' name, provides the top level name of the area of coverage of 
capabilities, attributes, communication and control interface. 

'Services_home\ provides area for home automation, consumer 
electronics, utility, etc. 

'Server_auto\ for an automobile in the garage and shows message 
interface available for one or more automobile types. For example, 
server_autoJbrd__explorer_98' is the interface for a particular automobile. This 
allows access to mileage and maintenance interfaces of the automobile, and can 
also be used for remote access by an automobile manufacturer or garage for direct 
checking and remote diagnostics, for example. 

£ server_samsung_web_site\ provides for communicating with a 
manufacturer Web site outside the home. Includes interface for message, service, 
help, etc. 

'AVC^commands' and 'CAL_commands', provides for legacy devices 
capable of interpreting AV/C and CAL languages, for example. This portion of the 
structure identifies commands in said languages, where the commands are tagged 
and carried in XML. As such, the contents are not XCE (Web) objects, and protocol 
converter applications can be utilized to interface to the original CAL or AV/C 
application software. 

In the above description, 'Services_home' provides the main structure 
including A/V consumer electronics. A branch of the structure is expanded in detail 
for a particular example of a video services sink, and stream destination (e.g., 
DVCR) control interface. The control interfaces in a typical home network can 
include: 

'xmLutility', provides details for supporting utility network functions 
such as downloading an updated DTD file, interface file, program file, etc. 

'client', describes the interface details of a client device 12 including a 
Web browser. For example 'acknowledgment' indicates the controller's acceptance 
of acknowledgment of a message or command sent out. 

'server_av\ provides control and capacity interfaces for all audio and 
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video services available, including STB, DVCR, DTV, DVD, AUDIO, etc. 

'lighting', provides an interface to a home automation lighting 
controller, and includes sensors, lights, etc. 

'comms', provides control interfaces to communications devices, 
typically for utility purposes or remote management of the devices 1 set-up or 
parameters, or for restoring configurations. 

'hvac', provides interfaces for remote control of the HVAC system, and 
can be used for control of said system from outside the home by the utility company, 
for example, to turn the home's HVAC system off during peak load periods of the 
day. Further, said interface can be used for controlling the HVAC system from 
within the home, by an appliance for device based controller to provide a more 
sophisticated control mechanism than thermostat control. 

'utility', provides interface for reading utility meters for the home, for 

example. 

'security', provides interface for security sensors and alarm settings. 
As such, using the interface, applications running on a home network device can 
have access to the sensor and detector devices around the home for monitoring and 
controlling of the those devices. 

'appliances', provides interfaces for kitchen, utility and general home 
appliances, including, for example, providing remote control or monitoring 
temperature settings or other controls and parameters from a controller device. In 
one scenario, a microwave appliance can scan bar code information on the 
packaging of a food item and access a manufacturer database to obtain cooking 
time of the food for a given microwave system type. Such integration of appliances 
using device to device command and control provides many control scenarios for 
providing services such as automatically pausing a dishwasher and muting a TV 
when a phone is picked up in the kitchen or family room. 

'convenience', provides interfaces to devices for providing convenience 
services such as interface to a curtain, window, blinds or whirlpool controllers, for 
example. 

In the above description, 'server_av' is part of the structure for the control 
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interfaces for A/V appliances offering A/V stream service, and is subdivided into 
'controls-gen 1 , 'source 5 and 'sink' capabilities. 

'controls-gen', provides interface for device manufacturer attributes 
and general utility interfacing such as ping testing the presence of the device. 
Further, manufactured-in attributes such as software and hardware identification and 
version information can also be included. A device supplying this interface returns 
data providing name or identification for said software without effecting any control 
actions. An interface to set the time of day clock can also be included. 

'sink', provides interface for the media stream service devices. The 
structure is organized based on service offered (i.e. video stream record and replay) 
rather than particular device names such as VCR. For example, a Tuner and a DVD 
player are both video program stream sources for the network with video program 
formats, and can be controlled, such as started and stopped. Differences in control 
of particular devices are addressed by the lower layers of the definition structure. 

'source' provides interface similar to the 'sink' interface. 

Referenced above, 'servicejd' or 'application Jnterfacejd' includes the 
name, address or Web address or URL location of one or more devices 14. 
Because the XCE database 104 comprises the totality of agreed upon interfaces, 
typically a Dynamic Host Configuration Protocol (DHCP) software agent executes to 
assign an address and a default name to each device, and the address and a 
default name are added the interface of the service or device. The software agent 
110 then collects device interfaces 72 which include subset or 'device partial XCE' 
definitions from all the devices locally connected to the home network to generate a 
'network partial XCE'. Additional relevant external interfaces can be added to the 
structure for external control. For example 'service_id' can be a name/address in a 
received structure or in a network Interface Library 106 including entries from the 
software agent according to the device interfaces of the devices connected to the 
network. Thereafter, a user can search for a service in the database and access an 
application whose interface includes a particular data branch of the library using said 
name/address. As such, the network can include multiple identical services 
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distinguished by said name/address information. 

'media', provides interface for the type of media including, for example, 
transport stream from a tuner, RAM from a PC DRAM, disk for CD or DVD, and 
tape. The media can be named and identified, and a controller device can search 
5 the XCE data base to identify the media currently provided on the network. When a 
new media such as DVD disk is provided on the network, that portion of the device 
interface 72 identifying the program material on the disk is changed accordingly. As 
such, the entire device interface 72 need not be transferred and only the relevant 
portion is transmitted to the XCE data base. On receipt of an attention signal, the 
10 library software agent 110 can fetch the new update and place it in the proper place 
in the interface library 106. The addition of the disk media is similar to adding a 

yg service to the network or connecting another appliance to the network. 

j£j 'rate', provides a value for data stream rate for a device interface, such as 6 

Mbits/Sec or 1 9.2 Mbits/Sec, for example. 

Ol5 'protocol 1 , identifies the protocol used for said data stream. If more than one 

T protocol is provided, for example 61883/1394 or UDP/IP, then a desired protocol can 

ri be selected. 

O 'streamjbrmaf, provides packet format and/or compression standard for 

,0 digital stream audio and video split If more than one format is provided, a desired 
4 i20 format can be selected via an interface message. A controller application 82 can 
examine the available formats to determine if there are compatible ones. 

'controls_av', provides the main control interface for AA/ media appliance. 
( Flow_control\ provides data stream controls such as: PLAY, STOP, GOTO, 
RECORD, etc as methods for a particular device. The methods do not change for 
25 embedded appliance, except for PC software, for example. The controls can include 
time parameters for delayed operation. 

Tuning', provides interface fortuning control. A controller device 14 can 
send a request to the interfaces of a controlled device 14 to send back an Electronic 
Program Guide (EPG) data structure described above. 
30 'Ul control', provides control interface to a controlled application 84 to control 
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adjustments for display such as brightness and contrast, and for audio, such as 
volume and bass. 

Timer^record' provides interface for set-up data for a controller application 82 
to implement delayed time recording. Direct channel tune information and flow 
control (time_aparams) information can be utilized. 

The above description can apply equally to client devices 12. An alternative 
syntax XCE definition or database for the CE space can be utilized. The alternative 
syntax XCE data base includes full service descriptions including home automation, 
appliances and automobile, for example. In cases where a service object provides 
flexibility and parameters for control, a control method is utilized to control the object 
as desired. Appendix 3 shows example commands in the AV/C and CAL command 
languages including binary and hex data strings. 

In another aspect, the present invention provides for use of existing command 
language implementations for device-to-device command and control in a network. 
Devices can include internal objects and APIs which, at run time, create binary 
strings according to existing transport mechanisms. In that case, in order to provide 
XML remote procedure calls (XML RPC) from one device 14 to another device 14 in 
the network, the exiting application interface implementation is replaced with calls to 
the XML service API. As such, the original implementation is equivalent to a 
wrapper for the XML service API. Figure 18 also shows applications created using 
other command languages such as CAL or AV/C in dashed lines, with their interface 
implementations replaced with a wrapper in the XCE/XML service API. Appendix 4 
shows examples for changing from CAL command language to XML RPC format. 

Referring to Figure 23, in another aspect, the present invention provides a 
standard command protocol and control language translation for inter-device 
communication between disparate devices in a network. For different devices to 
share information, the information must be in a format that a requesting device can 
interpret. And, for a device 120 to control another device 22, the two devices must 
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use a common language in order to interpret one another's commands. The present 
invention provides a common identification format for data and command protocols. 

In one embodiment, a method of common presentation or packaging of data 
and command protocol is provided, whereby a receiving device 122 can determine 
5 the native format of transmitted data. If the receiving device 122 can interpret that 
native format, then it can accept the data directly. Otherwise, the receiving device 
122 can request a translator device 124 or application to translate the data into a 
desired format which the requesting device 122 can interpret. The translator device 
124 or application determines the native format of the original data, translates the 
10 data into said desired format, and sends the translated data to the requesting device 
122. 

J2! The requesting device 122 then processes that data as though the data had 

N originally been provided in the requesting device's native language format by the 
O sending device 120. The requesting device 122 can also send a response back to 
7 15 the sending device 120 in the requesting device's native format, or send a response 
J ; ;5 by proxy through the translator device 124 or application for translation into the 
O native format of the sending device 120. The translation method can be utilized for 
■ 9 £ information including command protocols, data files and audio/video streams. 

For devices that do not utilize the common format described above, the 
20 present invention provides for translation of data including command protocols to, 
and from, such non-compliant devices. For example, when a non-compliant device 
120 sends data to a compliant device 122, the compliant device 122 can translate 
the data based on a determination of the native format of the data. For example, the 
compliant device 122 can examine the data for particular bit patterns within the data. 
25 When a compliant device sends data to a known non-compliant device, the 
compliant device can translate the data before transmission based on a 
determination of the native format of the non-compliant device. 
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An example implementation can be for a home network which supports the IP 
and HTTP protocols. The home network can be connected to the Internet to obtain 
applications and services of various types for desired functionality. As such, the 
common format method can be made compatible with Internet protocols and 
5 procedure for operation over the Internet and the home network. 

One example of providing a common data format is utilizing XML to create a 
package for the data for transmission over the home network. The data can include 
command protocol, streaming audio or video, graphics or applications. The data is 
'wrapped' with a standard header identifying the native format of the data and 
10 contents of the package, in XML form. The header allows unique identification of 
the data type the data portion of the XML code, whereby the data can be translated 
if necessary and provided to appropriate applications upon receipt. 



2 Under the Web standard, the identification process is performed by browsers 

O using file name extensions to identify the type and contents of a file transmission. 
J 15 The browsers then launch appropriate plug-in modules to process the file. In the 
}p! home network, XML is utilized to identify data transmissions which provides all home 
O network transmissions over IP with a common identification method as described 
=C above. 

Alternatively, a software layer can be provided in the home network protocol 
20 stack to uniquely identify the contents of all data transmissions over the home 

network. The software layer can be used instead of XML. The common format and 
identification principles of the present invention apply equally in either embodiment 
using XML or said software layer as identification methods. 

In Figure 23, upon receipt of a data package transmission, the receiving 
25 device 122 examines the XML identity header of the data package to determine the 
format of the data therein. If the data is in a format recognizable by the device 122, 
the XML identity header information is discarded and the device processes the data 
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directly. Otherwise, the device 122 converts the received XML package into an XML 
translation request package and sends the request package and the data to the 
translation server device 124. 



The translation server device 124 translates the data and converts the 
translated data into an XML translation response package. The translation server 
124 then transmits the response package back to the requesting device 122. In 
case of a translation error, the translation server 124 can provide a translation 
response error condition to the requesting device 122. Upon receiving the translated 
data, the requesting device 122 processes the translated data in the response 
package. 



Example of an XML data package or packet can be: 

IDENTITY type=format=AV/c>... packet data ...<\IDENTITY> 

Example of a translation request package or packet can be: 

TRANSLATION REQUEST type=Command format=CAL> 
<IDENTITY type=Command format=AV/C>... packet data 
...</IDENTITY> 

^TRANSLATION REQUEST> 

Example of a translation request package or packet can be: 

TRANSLATION RESPONSE type=Command format=CAL>... packet 
data ... 

^TRANSLATION RESPONSE> 

Example of a translation response error condition package or packet can be. 
TRANSLATION RESPONSE type=Command format=CAL>... packet 

data ... 

<ERROR condition=Unrecognized command>Translation could not be 

performed<|ERROR> 
^TRANSLATION RESPONSE> 



Further, Table 3 in Figure 24 includes a partial list of package or packet types 
and formats. 



To provide translation services, a translation server 124 is identified in the 
network during network configuration in a manner similar to that of DHCP servers. 
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The translation server 124 broadcasts its IP address to all devices in the network for 
a period of time after the network is configured. All devices 120, 122 compatible 
with the translation services store the IP address of the translation server 124 as it is 
broadcast over the network during network boot up. 

Alternatively, the requesting device 122 can broadcast a translation request 
over the home network. All translation servers 124 in the network that receive the 
translation request can respond to the translation request by sending a translation 
response to the requesting device 122. The requesting device 122 then selects one 
translation server 124 among the responding translation servers. In one example, 
the requesting device 122 selects the first translation server 124 that responds to the 
translation request. In another example, the translation servers 124 can negotiate 
among themselves and/or with the requesting device 122 for the selection of a 
translation server 124 for satisfying the translation request. 

In another embodiment of the invention, multiple translation servers 124 are 
utilized to fulfill all translation requests. For example, a single translation server 124 
may not have the capability to translate all requests. In such cases, it is necessary 
to identify the address of each translation server 124 and the type of translation 
service each translation server 124 can provide. Each device 120, 122 can store a 
list of all translation server IP addresses and a corresponding list of the types of 
translation services each translation server 124 provides, and optionally the 
associated translation application. 

For efficiency, if a sending device 120 wishes to send data to a receiving 
device 122 which is known to use a different native format than that of the sending 
device 120, the sending device 120 can send the data to the receiving device 122 
by proxy through a translation server 124. The sending device 120 transmits a 
command to the translation server 124 similar to the translation request command 
and includes the address of the receiving device 122 as the destination for the 
translated data. 
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In cases where a receiving device 122 requires translation of a data stream, 
the sending device 120 can route the data stream directly to a translation server 
124, and the translation server 124 in turn transmits the translated data to the 
receiving device 122 as described above. Alternatively, the sending device 120 can 
send the data stream to the receiving device 122, and the receiving device 122 then 
routes the data stream to the translation server 124 for translation and return of the 
translated data back to the receiving device 122. 

In the description herein, the control mechanism is based on the Hypertext 
Transfer Protocol (HTTP 1.1) which provides an application-level protocol for 
distributed, collaborative, hypermedia information systems. HTTP is a generic, 
stateless, object-oriented protocol in wide use for many tasks. A feature of HTTP is 
the typing and negotiation of data representation, allowing systems to be built 
independently of the data being transferred. Preferably, the network protocol used 
by devices and applications on the home network is IP (Internet Protocol). 
However, other protocols can also be utilized. 

Although the present invention has been described in considerable detail with 
regard to the preferred versions thereof, other versions are possible. Therefore, the 
appended claims should not be limited to the descriptions of the preferred versions 
contained herein. 
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CLAIMS 



What is claimed is: 

1 . A method for performing a service on a home network, the method 
comprising the steps of: 

(a) connecting a first home device to the home network; 

(b) connecting a second home device to the home network; 

(c) providing a database including a plurality of application interface 
description data objects, each application interface description data object including 
information in a structured format for commanding and controlling of a home device 
by one or more other home devices connected to the network; 

(d) the second home device accessing a first application interface 
description object for the first home device in the database; 

(e) the first home device accessing a second application interface 
description object for the second home device in the database; 

(f) sending control and command data from the first home device 
to the second home device utilizing said application interface description object for 
the second home device over the network; and 

(g) sending control and command data from the second home 
device to the first home device utilizing said application interface description object 
for the first home device over the network; 

whereby the first and second home devices perform said service. 

2. The method of claim 1 wherein the structured format includes XML 
format. 

3. The method of claim 1 wherein step (c) includes connecting a 
database device to the network, wherein the database device stores said database. 
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4. 



The method of claim 3 wherein: 



(i) 

therein; 

(ii) 

data therein; and 
(iii) 



the first home device stores the first application interface data 



the second home device stores the second application interface 



5 



step (c) includes an initial step of forming said database by 



steps including querying the first and second home devices to transfer said 
application interface data for the first and second home devices to the database 
device. 

5. The method of claim 1 wherein step (d) includes providing the first 
application interface description object for the first home device from the database to 
the second home device over the network. 

6. The method of claim 1 wherein step (e) includes providing the second 
application interface description object for the second home device from the data 
base to the first home device over the network. 

7. The method of claim 1 further comprising connecting three or more 
home devices to the network, wherein at least one home device accesses the 
database to query the application interface description objects of a plurality of home 
devices for sending command and control data to the plurality of home devices over 

5 the network. 

8. The method of claim 1 wherein each application interface description 
object includes data in a structured format. 

9. A network system for providing a service, comprising: 

(a) a physical layer, wherein the physical layer provides a 
communication medium than can be used by devices to communicate with each 
other; 
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(b) first home device; 

(c) a second home device; 

(d) a database including a plurality of application interface 
description data objects, each application interface description data object including 
information in a structured format for commanding and controlling of a home device 
by one or more other devices connected to the network; wherein: 

the second home device includes application control means for 
accessing a first application interface description object for the first home device in 
the database and sending control and command data from the second home device 
to the first home device utilizing said first application interface description object; and 
the first home device includes application control means for accessing 
a second application interface description object for the second home device in the 
database and sending control and command data from the first home device to the 
second home device utilizing said second application interface description object; 
whereby the first and second home devices perform said service. 

10. The network system of claim 9 wherein the structured format includes 
XML format. 

1 1 . The network system of claim 9 further comprising a data base device 
storing said database. 

12. The network system of claim 1 1 wherein: 

(i) the first home device stores first application interface description 
object therein; 

(ii) the second home device stores second application interface 
description object therein; and 

(Hi) said database base device forms said date base by querying 
the first and second home devices to transfer said first and second application 
interface description objects, respectively, to the database device. 
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13. The network system of claim 9 wherein the control application means 
of the second home device obtains the first application interface description object 
for the first home device from the database. 

14. The network system of claim 9 wherein the control application means 
of the first home device obtains the second application interface description object 
for the second home device from the data base. 

1 5. The network system of claim 9 further comprising three or more home 
devices, wherein at least one home device accesses the database to query the 
application interface description objects of a plurality of home devices for sending 
command and control data to the plurality of home devices over the network. 

1 6. The network system of claim 9 wherein each application interface 
description object includes data in a structured format. 

17. The network system of claim 9 wherein the structured format includes 
XML format. 
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Abstract 



A method and system for performing a service on a home network, by: 
connecting a first and a second home device to the home network; providing a 
database including a plurality of application interface description data objects, where 
each application interface description data object includes information in a structured 
format for commanding and controlling of a home device by one or more other home 
devices connected to the network; the second home device accessing a first 
application interface description object for the first home device in the database; the 
first home device accessing a second application interface description object for the 
second home device in the database; sending control and command data from the 
first home device to the second home device utilizing the second application 
interface description object over the network; and sending control and command 
data from the second home device to the first home device utilizing the first 
application interface description object over the network. Whereby, the first and 
second home devices perform said service. 
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